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Plan Proposed by the Board of Examiners, 

Board of Education and the Chancellor, 316a 
for Licensing, Supervisors in the New 

York City School fSysten. 


Introduction 


This proposal outlines a procedure for the develop- 
ment of examinations by the Board of Examiners to fulfill 
its statutory responsibility to provide examinations for the 
licensing of supervisors on the basis of “merit and fitness" 
through the use of "open qualifvins" examinations. To achieve 
this odjective the proposal provides for: 


(1) Job analyses of all supervisory positions; 


(2) Development cf job-related examinations which 


shall consist of the following essential steps - - 


Step 1 shall consist of a comprehensive assessment program, 
whose results shall be scored and reported in a manner more 
useful to the new Community Schcol Board type of administra- 
tion and which shall result in the provisional licensing of 
all eligible applicants except those who fail to meet levels 


of minimum acceptable performance. 


Step 2 shall consist of an on-the-job performance evaluation 
of persons who have served with provisional licenses, and 

shall result in the permanent licensing of those found to have 
performed reasonably. 


(3) A procedure for validating examinations. 


The goals of the proposed program are: 
(1) to develop non-discriminatory personnel 


selection policies without abandoning the essential elements 


ua? 
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of a merit system; 


(2) to build in performance evaluation as a 
key component of the licensing process; 
(3) to insure employing authorities a broad 


choice among qualified applicants. 


Accordingly, the primary purposes of the Board of 
Examiners' evaluation at Step 1 are to screen out those who 
fail to meet levels of minimum acceptable performance, and 
with respect to all other applicants to provide community board 
and Central Board of Education hiring authorities with the maxi- 
mum useful information possible so that they will have an in- 
formed basis for making decisions regarding the selection of 
those most highly qualified for service in their particular 


schools and districts. 


i. JOb Analysis 


1. The Board of Education, in consultation with the 
Board of Examiners and other interested persons and groups, 
will develop job analyses for all positions for which the 
Board of Examiners is required to conduct examinations. The 
job analysis will be based on a determination of the job 
behaviors which include the tasks the person is called upon 
to perform, the amount of time devoted to these tasks, their 
relative importance, and the knowledge and skills which enable 
a person on the job to perform these tasks successfully. The 
proposed procedure should be viewed as a model for analyzing 


all jobs although specific procedures might differ for specific 
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As a general rule, the job analysis will be developed 


from data which will be accumulated in the following way: 


A. One resource in developing the job analysis 
will be analytic descriptions of the handling of 
such jobs by incumbents presently serving in such 
positions. To utilize this resource observers 
selected by the Board of Education who have a back- 
ground in the specific license area and/or are 
trained in job analysis (could be non-pedagogues) 
will be trained and periodically retrained in 
observation techniques. These observers will 
visit school sites to observe incumbents in the 
position to develop descriptions of the work they 
are performing. Sufficient numbers of all-day 
visits will be made to the schools over repre- 
sentative periods to insure that the description 
includes both daily and periodic tasks. Observers 
will be required to record all tasks performed by 
incumbents indicating not only a description of 
the task but the time allotted to each and to 
indicate the relative importance of the described 
behavior in terms of effective performance. To 
insure that the analysis includes consideration 
of the widely varying schools and districts in the 
City of New York, the sampling will include in- 
cumbents in schools located in districts of varying 
socio-economic evein. Any other steps necessary 


to assure meeting the differing needs of various 


| 
| 
| 
| 
1 
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districts will be fully considered. 

B. Observed incumbents will be asked to 
provide the Board with a log of their activities 
in the job. 

C. Incumbents' logs will be compared with the 
observers' logs developed in accordance with (A) 
above. The incumbent's supervisor will evaluate 
both the observer's log and the incumbent's des- 
cription tc determine the relative importance of 
the described behavior in terms of effective per- 
formance. The job description will incorporate 
observed and reported data, together with the super- 
visor's judgments. 

D. The Chancellor, Community Superintendents, 
Comunity School Esards and/or Parent Associations 
will be consulted as to their perceptions of the 
job. Such perceptions shall be considered in the 
development of the job description. 

E. As a further effort to insure the soundness 
of the job analyses, the Board of Education will 


‘ 


subject each analysis to review by the following: 
1. A Community Superintendent or Central 
School Superintendent. 


2. A college or university specialist 
in the relevant area. 


3. <A personnel specialist from cutside 
the New York City School System. 


4, An incumbent supervisor in the relevant 
category. 
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5. A Community School Board represe:ta-—- 
tive designated by the Chancello.’. | 


Where there-is an appropriate group which is rep- 
resentative of any of the aforesaid categories, the Board 
will seek designees from such group. However, the final 
selection shall be by decision of the Board of Education. 

The designees shall review each job analysis and 
shall make recommendations to the Board concerning same. The 
decision of the Board of Education, however, shall be final. 

2. Based on the data developed in "1" above, the 
Board of Education shall prepare a job analysis and descrip- 
tion for each position for which examinations are to be con- 
ducted. This job analysis shall set out and fully elaborate 
all of the important qualities and/or behaviors necessary for 
performance of the job. It shall also indicate the relative 
importance of the various qualities and behaviors and the de- 
gree of significance each has in determining overall effective 
performance. In drawing up these analyses the views of in- 
cumbents, their supervisors and those persons consulted pursu- 
ant to "D" above, as well as pertinent research literature 
shall all be taken into account. 

The Chancellor and the Board of Education will also 
utilize the process of develoning job analyses to review 
existing job titles, combining titles and/or creating new 
titles, where appropriate. 

As a further aspect of preparing job analyses every 
effort will be made to identify common elements in jobs which 


might lend themselves to assessment in a common test. Similarly, 
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in utilizing job analyses every effort will be made by the 


Board of Examiners to identify common elements in jobs which 
might lend themselves to assessment in a common test. 

In order to insure broad public acceptance as to 
the objective simstementation of the procedures set forth 
herein and in "1" above tne Board of Education will retain 
a recognized consulting firm to develop and: prepare the first 
three job analyses as prototypes pursuant to the procedures 
set forth herein and in "1" above and/or such other pro- 
cedures as the firm deems appropriate. The prototype analyses 
shall cover the positions of Principal - Elementary School, 
Assistant Principal - High School (Supervision), and Assistant 
Princ‘’-al -— Elementary and Junior High. These positions cover 
the largest number of peoole in the supervisory categories, 
thus permitting the program to start in a meaningful way. 
These analyses will thereafter serve as models for future 
job analyses to be develcped by the Board of Education. In 
doing these analyses the consulting firm shall be guided by 
the goals described supre of ident.fying common elements in 
jobs which might lend themselves to assessment in a common 
test, and of reviewing existing job titles with a view toward 
making recommendations to the Chancellor and Bosra of Education 
regarding the combination of titles and/or creation of new 
titles, where appropriate. The consulting firm shall also 
recommend a program for the selection and training of persons, 
to conduct subsecuent job analyses. The Board of Education 
has designated American Institutes for Research, 3301 New 
Mexico Avenue Itl.W., Washington, D.C. 20016, as its consultant 


in connection with the development of job analyses for prototype 
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examinations. The Board of Education, in its discretion, 
may use consultants to perform services in the development 
of future job analyses. 

3. The Board of Examiners will determine the 
feasibility of the development of tests for families of 
jobs that require similar qualities and behaviors. It would 
then be possible for similar tests to be administered for a 
group of jobs that call for similar knowledges, skills and 
behaviors. The Board of Examiners, in its discretion, may 


use consultants to perform services in this connection. 


IT. Job-Related Examinations 3238 

The Board of Examiners will develop examinations 
based on the aforesaid job analyses which measure the appli- 
bats capacity to perform the significant job requirements 
as indiv. ted by the analysis. This examination process will 
be divided into two steps. Step 1 will consist of a series of 
tests to be given to all e1égteTe applicants for the primary 
purpose of ecatuakins the applicants' strengths and weaknesses. 
All persons who meet levels of minimum acceptable performance 
under Step 1 shall be declared eligible for provisional appoint- 
ment to the position in question. Step 2 of the examination 
process will be administered to those persors who secure such 
provisional appointment. t shall consist of an on-the-job 
performance evaluation at the end ot’ one school year of pro- 
visioral service. Any person found to be performing reasonably 
in the Step 2 evaluation shall be awarded a permanent license 
for the position in question. 

A. Description of Step Tests 

A variety of tests may be used at this stage. 
They "ay or may uot include written examinations, depending on 
the needs of the partic lar situation and the nature of the 
qualities being evaluated. These Step 1 tests are likely to 
include some combination of the following: 
1) Situational teuce or job simulations - 

tests which place the applicant in a realistic 

job setting and call upon him to exnibit appro- 

priate behavior. Thus, if administrative ability 

is a job requirement, an in-basket test may be 

used. This test uses a hypothetical but realistic 


in-besk.c containing letters, memoranda, records 


f 
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of incoming telephone calls and other documents 


normally found in the in-basket of the school 


administrator. The applicant -< * *he 
necessary background informatica cv. cerning the 
school in which, as principal, he would be faced 
with the specific in-basket. He is told that he 
is the incumbent principal and that he must re- | 
spond to the materials as he would actually respond | 
on the job by 
a) handling certain matters himself immediately 
b) handling others himself at a later time 
c) delegating some to staff for immediate 
action and 
ad) delegating others to staff for later action. 
After a period of study of the documents, 
he may be asked in an interview to give the 
reasons for the decisions he has made in 
handling the in-basket and to defend them. 
2) Job knowledge tests - written and/or performance 
tests which meésure the applicant's knowledge of 
subject matter required by the job. Thus an appli- 
cant for the position of Assistant Principal 
Supervision (tiathematics) D.H.S. might be required 
to devonstrate a knowledge of the curriculum and 
materials of his subject to the extent that the job 
analysis identifies that) knowledge as important to 
the performance of the job. 


3) Tests of communication skills - written and/or 


oral tests which will require the applicant to 
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demonstrate his ability to write and speak effec- 


tively to students, staff, parents and the community. 

4) Tests of special experience - tests designed to 
give an applicant the opportunity to demonstrate his 
Knowledge of special areas that may be deemed impor- 
tant by particular Community School Boards, e.g., 
knowledge of a foreign language. or knowledge of the 
culture of a particular ethnic group. 

5) Physical and medical test. 

6) Inspection test - evaluation of the performance 
of an applicant on the job currently held. Every 


effort will be made to include such evaluations in 


the Step 1 assessment, although considerations of 


cost may preclude extensive performance evaluation 

in some examinations involving large number of 

applicants. 

In order to insure that tests are job related, they 
will be created by closely ratching the tests and test tasks 
to the important elements of behavior on the job as identified 
in the job analysis. The job analysis will be reviewed and 
selected behaviors listed will be translated into test tasks. 
The sampling of test tasks will reflect in microcosm the com- 
plex conditions of the job itself. Ear> test item in a written 
test and each test, be it inte 7view or simulation, will be 
identified by a code referring to a specific item on the job 
analysis. This cross reference system will insure that test 
tasks used will be based on the job analysis. Test items will 
reflect the relative importance assigned to the task in the 


job analysis. 
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B. Reportins of Results of Sten 1 

In the past, specific weights were attached to 
each cne of the battery of tests with a few exceptions (written 
English, physical and medical, and records were rated either 
Satisfactory or unsatisfactory). A candidate had to achieve a 
weighted average of 60 per cent on the battery of tests to 
pass. If a candidate scored less than 50° per cent on any part 
of the examination, he was eliminated. If he obtained 50 per 
cent or more, he was continued in the examination but he had 
to compensate for marks lower than 60 per cent because he had 
to achieve a weighted average of 60 to pass. 

To adapt the testing system to the needs of a . 
Community School Board type of administration, test results 
will be reported in a manner completely different from hereto- 
fore. Instead of a composite grade, a profile of performances 
Will te made available to the Central Board or to Community 
School Boards, whichever has Jurisdiction, for each qualified 
candidate. This profile will present an assessment of the 
performance of each qualified candidate in all tests without 
Specific weight and without exact composite numerical grades. 

The assessment will also include a narrative | 
report of the candidate's performance in the various areas 
tested as previously determined by the job analysis. For 
example, the assessment of a candidate in a principal's exanin- 


ation might report on the following areas: 


1) managerial abilities (e.g., handling of 
a variety of problems by proper organization, 
Planning, imagination and decision-making); 

2) supervisory abilities (e.g., competency 


to observe classroom teaching insigh and 


.* 
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to contribute to the improvement of teacner 

performance); 

3) interpersonal relationships (e.g., com- 
munications skill, sensitivity to the role of 
participants in a crisis situation, awareness of 
the human factors onerative in a school setting). 
The standards for assessment of performance on each 

test will be established by experts chosen b; the Board of 
Examiners in the areas covered and assessments in accordance 
therewith will be made by examiners chosen for their expertise 
in the area covered by that test. Thus, in evaluating per- 
formance on an administrative in-basket, examiners will be 
drawn from a pool of experienced administrators in education 
and industry who will have participated in the job analysis or 
who will be familiarized with the adminstrative component of 
that analysis. The Board will include, where available, as 
assistant examiners and examination assistants qualified per- 
sonnel, from the varied racial and ethnic groups represented 
in the New York community. The examiners will rate performance 
in accordance with a scoring guideline that will identify the 
significant elements in the in-basket and levels of minimum 
acceptable performance based on the guideline. 

Similarly, in a supervisory simulation, standards and 
the level of minimum acceptable performance would be set by 
pooling expert opinion of those who had wide experience in 
supervising instruction in a variety of schools and who were 
thoroughly familiar with the content and methodology of the 


curriculum areas involved. They would view a representative 


videotaped lesson, and identify significant areas of strength 
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and weakness in the performance of the teacher conducting 

the Jesson and specific ways in which that performance could 

be improved. The candidate would appear before one of a number 
of panels of examiners consisting of school supervisors, 
university professors or other experts in supervision familiar 
with the specific sutject area and would evaluate the lesson 
and present a program he would seek to implement to improve 

the teacher's performance. 


No assistant examiner or examination assistant shall 


participate in the administration of any test without having 


first received appropriate training. 


A sample profile format follows on the rext page. 
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Sample Assessment Profile Format 


(The tests indicated are merely examples of those which 
might be used. Total assessment is not res ricted to 


these examples.) c o = 
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Understanding of Essential Principles 
of Administrative Behavior 
(as measured by "in-basket" 


situations) — 


Ability to Evaluate 

Observed Classroom Teaching and tc | 
Effect Improvement 

(as measured by response to accual 
teaching) 


Understanding of Human Relations 
Principles Involved in School a 
Management (as revealed by reactior. Cg 


to taped situations) 
* Understanding of the Educational 
Process in the Urban Setting 


(as revealed in a written test on 


educational literature - for entry 

level as chairman or assistant i 

principal) | ne 
Communications Skills: Ability to | es 
Communicate to Staff, Students, ~ 
Community 


(as revealed in simulated tasks) 


skills in English Communication 

(as revealed in a writing sample - for 

entry level as chairman or assistant 

principal) | 
| 


Inspection Test 
Physical and Medical Tes? 


Record, Including character and 
evaluation of past experience 

(including fingerprint check required 
by Board of Education) 


Special Skills Tested at Applicant's 
Request (e.g., knowledge of Spanish) 


Special Experience 
(identified from vita s:nplied by 

applicans and verified »y the Board 
-. Toy amt pone ie 
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It can be ceecn from this sample profile that, 


thoutth the candidate is qualified overall, he is unqualified 
in one of the areas tested. In the event that the performance 
of the applicant is determined not to meet the level of 
minimum acceptable performance in an area deemed essential 
by the job analysis, he would be rated unqualified and not 
recommended for licensing and a place on -the qualified list. 
This level of minimum acceptable performance shall be set 
with a view toward screening out the unqualified, consistent 
with the primary purposes of the Step 1 evaluation which are 
to ensure employing authorities the broadest possible choice 
among qualified applicants, and to provide with respect to 
such applicants the maximum useful information possible so 
that the employing authorities will have an informed basis 
for making decisions regarding the selection of those most 
highly qualified for service in their particular schools and 
districts. A rating of unaqualified in one or more areas not 
deemed essential by the job analysis would not prevent the 
applicant from being placed on the qualified list, although 
said ratings would of course be reflected in the applicant's 
assessment profile. 

Upon receipt of the list of qualified eligibles, 
together with their assessment profiles and narrative report, 
each Community School Board could evaluate the indicated 
achievement levels of each eligible in the lights of its 
own needs, attaching more importance to some aspects of the 
total assessment and less importance to others. Thus, a 
candidate who did poorly in English communication but well 


in administration and supervision might be more acceptable 
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to one Community School Board than to another. Another 
aspect of the profile would be the evaluation of additional 
skills claimed by the applicant; thus, an applica:.. ao 
claimed fluency in Spanish would be tested for that skill 
and this additional qualification will be reported together 
with the other aspects of his assessment. 

The Board of Examiners would uadertake to 
provide a manual to help Community School Boards interpret 
the results reported and would consult upon request with 
any Community School Board in matters of personnel 
selection. Further, in the case of applicants whose assess- 
ment profiles did rot include adequate evaluations of oer 
performance, the Board would provide additional assessment 
service. Each Community School Board could submit to the 
Board of Examiners a list of reasonable length of qualified 
persons in whom they were interested for a particular 
Supervisory position, for an assessment of their performance 
in the job they currently hold. The Board of Examiners 
would evaluate by an on-the-site inspection by a team of 
experts each eligible as to performance in his current job, 
wherever he may be serving, and submit a report of its 


findings to the Community School Board. 


C. Frequency of Step 1 Examinations 
and Establishment of Continuing 
Eligible Lists for Persons ‘ith 
Provisional Licenses 


The parties agreed to, and any settlement agree- 


ment is conditioned upon, the entry of a remedial order by 


the Court providing that, in order to maximize the Opportunity 


for qualified minority applicants to compete for Supervisory 


positions: 
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1. The Stcp 1 screening process for any particular 
examination shall be completed as quickly as is administratively 
feasible. 

2. Step 1 examinations for every separate job 
title for which there are vacancies shall be ordered by the 
Chancellor in connection with the Community School Board 
Consultative Council as frequently as it is administratively 
feasible for the Board of Examiners to give such eraminations 
and it appears appropriate, in order to insure employing 
authorities the broadest possible choice of qualified appli- 
cants. In any event, said examinations shall be ordered and 
Biven whenever the number of persons with provisional licenses 
on an existing list falls to 50% of the number on the list 
at the time of its establishment. 

3. Successful candidates for provisional licensure 
shall have their names added to, and shall remain on, eligible 
lists for a period of four years. 

The provisions of paragraphs"1" through "3" above 
shall be effective for a period of 5 years from the date of 
the armouncement of the last prototype examination, notwith- 
standing any provision to the contrary contained in any law, 
regulation or collective bargaining agreement, including 
specifically N.Y. Educ. Law § 2590-j.4.(f). 

The announcement of examinations by the Board of 


Examiners shall not precede the giving of such examination 


by more than six weeks. 


2 - 


D. Phasing Out of Interim System of Licensing 
on Basis of Performance Evaluation and of 
Interim System of Filling Vacancies 3338 
1. With respect to each supervisory job title, 
es, waa system of licensing on the vasis of performance a 
evaluation established pursuant to this Court's orders of : 
July 12, 1973, shall continue in effect for each job title 
enkes. a) The promulgation of an announcement of an 
examination for that title by the Board of 
Examiners at which time the interim system 
of evaluation for such title shall forthwith 
cease, provided, however, that all persons 
eligible for performance evaluation whose 
applications for such evaluation are filed 
prdaor to the date of said announcement, shall 
be evaluated pursuant to the interim system 
of performance evaluation and, where 
appropriate, licensed. 

b) If no announcement of examination is made for 
any particular job title, the interim system 
of performance evaluation shall cease on the 
later’ of the following dates: 

(1) The expiration date of any existirg 
eligible list for a particular job title or, 
(2) one year from the date of the announcement 
by the Board of Examiners of the last of 
the aforementioned three prototype 
examinations. 
Notwithstanding the foregoing provisions of this 
subparagraph (b),:‘all persons. eligible for performance 
evaluation whose applications are filed prior to the 


later of the aforesaid dat ee 2 Dc bed 


cae 4. a 
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pursuant to the interim system of performance evaluation and, 


where appropriate, licenscd. 


2. Pending the promulgation of a list of persons 


provisionally licensed for a particular job title pursuant 
to Step 1 hereof, vacancies in such title shall cont*nue to 
be filled in accordance with the provisions of Paragraph VIII 
of the July 12, 1973 orders of this Court, provided, however, 
that licenses shall not be granted to persons filling such 
vacancies in accordance with the performance evaluation 
procedure except as provided in paragraph "1" above. 

3. Upon promulgation of a list of persons 
provisionally licensed for a particular job title pursuant 
to Step 1 hereof, the interim system of appointment to 
positions in such title described in Paragraph VIII of the 


orders of July 12, 1973 shall forthwith cease. 


E. Description of Step 2 Test 

This step shall consist of on-the-job performance 
evaluation, after one school year of service, of any person 
given a provisional appointment after qualifying under Step i, 
A candidate will be rated satisfactory under Step 2 if he 
demonstrates reasonable performance on the job and will 
then be awarded a permanent license for the position in 
question. 

The on-the-job evaluation will assess the candidate's 
performance in terms of the essential elements of the job 
analysis through such activities, for example, as the following: 


classroom visits and a study of the applicants’ efforts to 


improve teacher performance (e.g., post-observation 
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conferences and reports, workshops, inter-visitation program, 
and demonstration lessons); interpersonal relations with 
staff and students (as evidenced, e.g., in staff meetings, 
consultative council meetings, and mectings with student 
government officers); relations with parents and community 
(as evidenced, e.g., in planning parent meetings, in 
involving community persons in advisory capacities, in 
using community resources in the instructional progrem); 
discussion with the applicant and his supervisor concerning 
the goals of the school, major problems that the applicant 
has faced in achieving these goals, and steps he has taken 
to solve these problems and provide a wholesome school 
environment and an effective instructional program. 

The panel conducting the evaluation will, in 
assessing the applicant's performance, consult with a broad 
cross-section of persons familiar with the applicant's work. 
For example, in the case of an elementary school principal, 
this would normally include the Candidate's supervisors, 
his fellow administrators, teachers working under hin, 
students and parents, as well as any persons designated by 
the community superintendent or the community board. 

F. Staff 

The Board of Examiners shall have as a major goal 
the development of a full time, permanent staff of persons 
drawn not only from education, but from such other fields 
as testing and measurement and private industry, as well as 
the use of examination assistants from outside the educational 
profession. Ti¢ Board shall develop and publish appropriate 


written selection criteria for both assistant examiners and 
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hall develop uppropriate 


examination assistants and 
training procedures for such staff. 

No member of the staff shall participate in the 
administration of any test without having first received 
appropriate training. Both 2ssistant examiners and 
examination assistants shall include, where availaole, 
qualified personnel from the varied racial and ethnic 
groups represented in the Ne: York community ans from 
outside the education profession. Nothing contained herein 
shall be deemed to contravene the provisions of Secti 2659 


of the New York State Education Law regarding the nomination 


or approval by the Chancellor or Community Superintendent of 
examination assistants. 

G. Appeal Procedures 

The program described above will continue the 
same safeguards that are currently in effect, nemely, the 
right of the applicants to full disclosure of the guidelines 
used in the assessment process with the right to eppeal from 
any or all of the findings at both Step 1 and Step 2. Such 
appeal shall be made in accoraance with Section 13 of the 
By-Laws of the Board of Examiners (copy of which is attached 
hereto) and may challenge any aspect of the examination 
including whether the examination is consistent with the 
general standards and procedures for testing at Step 1 and 
Step 2. 

The Board of Examiners will apprise applicants 
of their right to appeal, of the procedures to be followe.\, 
and of the procedures available to obtain review of any 


appeal der‘ed by the Board of Examiners. 


tii. Vaiiaetion 
pos. 337a 

The Board of Examiners will develop procedures 
to validate Steps 1 and 2 and the testing program on an 
on-going basis. In order to assure that these validation 
procedures are properly developed and performed, the Board 
of Examiners shall designate Development Dimensions, Inc., 
Suite 419, 250 Mount Lebanon Boulevard, Pittsburgh, Pennsyl- 
vania 15234, as its consultant or consulting agency to design 
and conduct validation studies of the examinations for the 
three prototype positions referred to in Section 1 supra. 
In carrying out its task the consultant or consulting ©. y 
shall be directed to design and implement va’idation pro- 
cedures which are consistent with applicable law. The pro- 
cedures so developed will serve as 2 model for subsequent 
validations, as appropriate. " 

The testing process shall be revised as necessary 


to make it consistent with the findings of the validations. 


IV. Licensing Procedure 

Candidates who are found to be qualified as a 
result of the Step 1 procedures described above shall be 
placed on an “eligible list" promulgated by the Board of 
Examiners and certified to the Division of Personnel of the 
Board of Education. Persons on such a list shall be eligible 
for provisional appointment to the jobs for which they have 
been tested. Once such a list has been established, appointing 
authorities shall be free to fill supervisory vacancies with 
persons who possess such provisional license. or with persons 
who possess licenses granted pursuant to the interim system 
of performance evaluation or with persons who possess licenses 


granted pursuant He Ae presi system of examination. 


rs 


After service in such job for sne school year the provisiona 
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appointee must be evaluated in accordance with Step 2 hereof. 


Those Candidates found to héve performed satisfactorily in 


accor ance with the Step © on-the-job evaluation described 


above, shali be licensed. Tne Step 2 evaluation shall be 
completed within the semester following the required scnool 


year of provisional service. 


V. Reporting Reauirements 
A. For the purpose of determining or securing 
compliance with the Finel Judgment, and for no other purpose, 
and subject to the entry of an appropriate protective order, 
the defendants will provide the following information with 
respect to the three prototype examinations described above 
in this Plan at the times indicated below: 
1. JGb Aneiyecs 

Upon completion of the job analyses, 

the Board of Education will submit 

the Consultant's report to plaintiffs’ 


counsel and to the’Court. 


2. Development of Step 1 examinations 
Upon announcement of the holding of 
a prototyve examination, the Board 
of Examiners «.i11 provide plaintiffs’ 
counsel and the Court with a descrip- 


tion of the scope of the examination. 


3. Administration of Step 1 examination 
(a) Copies 2% the examination announce 


ment will be submitted to plaintiffs' 


counsel and the Court at the tine 


Promptly after examinations are 
held, the following shall be given 
to plaintiffs' counsel and submitted 
to the Court. 

(1) 
(2) 


Copies of examinations. 

A report on the racial and 
etnnic composition, 1.e., 
black, Puerto Rican or non- 
minority, of the examination 
assistants who administer the 
examination. 

(3) A report on the racial and 
ethnic composition of applicants 
taxing, passing, and failing 

the examinations. 

(4) A copy of the notice given to 


applicants regarding their 


right of appeal. 


4, Development and Administration of Step 2 


examinations. 


Promptly after the completion of any 


prototype Step 2 examinations, the Board of Examiners shall 


give to plaintiffs' counsel and submit to the Court a re- 


port on the ethnic and racial composition of examination 


assistants who conducted Step 2 examinations. 


5. Validation Revorts 


(a) 


Promptly after the holding of 
each Step 1 prototype examination, 
the Board of Examiners shall give 


plaintiffs' counsel and submit to 


che Court a report on the content 


validity of such examination. 

A copy of the Consultant's validation 
Studies shall be given to the 
plaintiffs' counsel and submitted to 
the Court promptly after it is re- 


ceived by the Board of Examiners. 
B. For the purpose of determining or securing 


‘compliance with this Final Judgment, and for no other purpose, 
and subject to any legally recognizable privilese, and the 


entry of an appropriate protective order, defendants will 
provide plaintiffs' counsel with such other information with 


respect to the three prototype examinations described in the 
Plan as is necessary for them to make a determination re- 


garding compliance with this Judgment, provided that: 


1. plaintiffs' counsel give defendants 
reasonable written notice of the 


information required; and 
She information requested is relevant 


to a determination concerning com- 
pliance with this Judgment; and 


the request for information does not 
impose an undue burden on the de- 


fendants; and 
the information requested will not 


jeopardize the security of examina- 
tions or the confidentiality of the 
identity of examination assistants, 
provided, however, that in 19 event 
shall the Board of Examiners be re~ 
quired to disclose to the plaintiffs' 


counsel the contents of actual exami— 


nations in advance of the holding of 


such examinations. 
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AMENDMENT OF BYLAWS OF THE BOARD OF EXAMINERS 
Amendment No. 2? - January 18, 1972 


Tice Board of Examiners at its meetin~ held on January 18, 
1972, adopted the following motion: 


that Section 13, paragraphs 2, 3, 6 and 9 of the Bylaws 
Reard of Examiners be amended as follows: 


Motion 
of cre 
2. An apoeal shall be referred for consideration and appropriate 
action to two members of the Board of Examiners acting as 
appellate examiners. In the event that two members of the 
Board of Examiners are not available to act as appellate 
examiners, an appeal shail be referred for consideration 
and recommendation to tivo appellate reviewers who toox no 
pare in the ratine or conduct of the examination in which 
the ae failed, such apvillant reviewers to be 

the Board of Examiners. The 


designated by the Cnoirman of 
advisory services 


Board of examiners may avail itself of tne 
in the rating or. 
failed. 


of examination assistants who took no part 
conduct of the test in which the appellant 


Recormendations of the appellate examiners or appellate reviewers 
shall take the form of approrriate reports a ana be presented to tne 
Board of Examiners for its approval. In the absence of a quorun, 
the Chairman of the Board of Examiners shall process the appeal 
and_ Shai) report B42 aoneals acted upon by the the Chairman to the 
Boarc of Examiners at a sucseauent meeting at which a quorum m is 


Teo Wnen the appellate examiners or anpellate reviewers 


ent 
ve 


recommend that an appeal be sustained, 
provision for the reinstatement of the 


Tne standards to be applied in passing 
or supervision tests shal]i be tne same 


the report.shall include 
application involved. 


upon appeals in written 
as those applied in the 


rating of the answers of non-appellants. In this connection, 

the function of the appellete examiners or the appellate reviewers 
shall be to recommend any revision of appealed ratings necessary 
to web them into accord with such standards. The appellate 
examiners or the apneliate reviewers shall also correct any 
Sieesens errors or onissions which they may find. 


Ho cond appeal shall be entertained except by consent of the 
Beare of Exaniners or the Chairman of the Board of Examiners in 
the absence o! of a oucrun. Such consent shall be given only upon 
the preaentac: sation by the appellant of new material evidence that 
could not with due diligence on his part have becn presented in 
the first instance. 


“atter underlined is new. 
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Section 13. 1. An appl-cant no has been refused license or a 
certificate because of an unsatisfactory ratings in any exanination 
or in any test or other part of an examinaticn or because of 
ineligibility, shall have the risht to file an appeal, provided 
that such appeal is filed within a period of time following 
refusal of license or sertificete specified by rules and 
regulationc adopted by the Boarc of Examiners. The form and 
manner in which an appeal may bs filed shall also be determined 
by said =les and remulatiors. The same right of appeal shall 
also be -:corded to any license? or certificated person whose 
license or certificate has been torminated by r2ason of his 
failure to meet examination or eligibility requirements. How- 
ever, in regular examinations weere, in the judgment of the 
Board of Examiners, the schedule of examinations permits 
refiling for another examination prior to the time that an 
appea’? could reasonably be actes upon, no appeals will be 
entertained except in the case 5f those applicants who have | 
been refused license because of an unsatisfactory rating in the 
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appraisal of record, or en unsetisfactory rating in the physical 
ane medical test, or because of ineligibility. nm an unassembled 


‘examination. and in an emergency examination for substitute license, 


an applicant who has been refused license because of unsatisfactory 
ratings inne appraisal of record, or an unsatisfactory rating in 
the physicel and medical test, cr because of ineligibility me2y 
appeal from such determination. The Board of Exeminers may adopt 
rules end re 

minimum ratings are substitutec Tor pass mars in tro or more . 
tests and 2 pass mark is set on the weighted average of tvo or 

more tests. 


Gulations severninz eppeals in examinations in which 


2. An appeal shall be referrec for consideration and approzsriate 
action to two members of the Bo2rd of Examiners acting as aopellate 
examiners. The Board of Examiners may avail itself of the advisory 
services of examination assistents who took no part in the rating 
or conduct of the test in which che appellant failed. 

3. Recommendations of the -te examiners shall take the form 
of appropriate reports and 

for its aporoval. When the ap te examiners recommend that an 
appeal be sustained, the report 12 include provision for the 
reinstatement of the application involved. 


h. The reasons for the sustaining or the dismissal of an appeal 
sholl be set forth in writing. In the case of the dismissal of an 
appeal, @ summary stutement eo: cre reasons for the dismissel of the 
appval shall be available for inspection by the appellant. 


5. In the consideration of apreais in written tests and in 
- 


‘ 
supervision tests, the identity of the appellant shall be 
conevaled from the person or persons considering the appeal. 
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6. The standards to be applied in passing uroM ap ypeals in 
written or supervision tests shall be the scré as those applied 
in the ratinr of the answers of non-appellare: <n this 
connection, the function of the appellate examiners shall ve 

to recommend any revision_of appealed ratings necessary to 
brins them into accord with such standards. The appellate 
examiners shall also correct any clerical errors ov omissions 


which they may find. 


7. Except in case of clerical error or omission, th a, 
ratins in a written test or any part thereof or in a supervis 

test snall not be raised beyond aie passing grade or other pea val 
minimum grade substituted for th e passing grace. 


&. In peneral, the sustaining of an appeal on @ physical and 
medical test and on tests otner tran vne written or the supervision 
test snall provide for the granting ,* a continued test. However, 
the granting of an appeal on a B% rfecooeance test in which the rating 
4s besed solely on the tansiole pro .uct resulting from said test 

and not on the procedures of thes ap) cllant cdoserved in the course 
of the test, shall provide for ©.e ~nereace of the rating to the 

barely passing grade or ccher re uir.d minimum grade substituted 

tor the passing grace. 


9. No second appeal shall be entert: ined except by corsent “f tt. 
Board of Exeminers. Such consent shall te given only upon the 
presencation by the appeliant of nev erual evidence that ccoule 
not witn gue diligeace on his pert hive ween presen «dad in the 
first inscvarnce. 
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Plaintiffs’ Notice of Motion served January 3, 

1975, together with supporting affidavit of 

Jeanne R. Silver (plus exhibits), sworn to 
January 3, 1975 
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UNITED STATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 


—-— — mma 


BOSTON M. CHANCE, et al., 


Plaintiffs, 


~against- 


THE BOARD OF EXAMINERS AND THE 
BOARD OF EDUCATION OF THE CITY 
OF NEW YORK, 


cl a 


Defendants. 


Kaye, Scholer, Fierman, 
Hays & Handler 

425 Park Avenue 

New York, N. Y. 10022 


Adrian Burke 

Attn: Leonard Bernikow 
The Corporation Counsel 
Municipal Building 

New York, N. Y. 10007 


Attorneys for Defendants 


SIRS 


70 Civ. 4141 
(H.R.T.) 


NOTICE OF NOTION 


PLEASE TAKE NOTICE that, upon the annexed affidavit of 


Jeanne R. Silver, sworn to January 3, 1975, and upon the plead- 


ings and all other papers and proceedings had herein, and pur- 


Suent to paragraph IX of the Final Judgment herein entered July 


12, 1973 against defendant Board of Examiners and the Order hevein 
entered July 12, 1973 modifying the preliminary injunction against 
defendant Board of Education (hereinafter.the 
Orders"), plaintiffs will move this Court, at 
Courthouse, Foley Square, 


at 4 o'clock in the afternoon of that day, or 


New York, New York, 


"duly 12, 1973 
the United States 
on January 14, 1975, 


as soon thereafter 
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1. Issue an Order modifying the Final Judgment of July 12, | 
1973 against the defendants Board of Examiners and Chancellor sere- 
in to provide that a certain "Plan" annexed as Exhibit "A" to | 
the affidavit of Jeanne R. Silver submitted herewith, and all its | 
provisions and requirements shall be in orporated in such iidenett 
as "a Plan for the selection of supervisors within the New York 
City school system" and that any requirements of paragraph IX of 
Said Judgment shall be deemed satisfied thereby and cease to be in 
effect, and that the defendants shall be required to proceed 
immediately to develop a new system for licensing and selecting 


iad 


i 
| 
supervisors in the New York City school system in accordance with | 
{ 
. { 
the provisions of said Plan; and | 


2. Issue a Final Judgment containing the same terms as 
the aforesaid Final Judgment of July 12, 1973, as modified, 
against the defendant Board of Education and all other defendants 
herein who are not presently bound by the July 12, 1973 Final 
Judgment, 

3. Grant such other and further relief as the Court may 
deem just and proper. 

' | 
ELIZABETH B. DuBOIS j 
(Legal Action Center of the 
City of New York, Inc.) 
271 Madison Avenue 
New York, New York 10016 | 
(212) 679-6502 | 
JEANNE R. SILVER 
20 West 40 Street j 


New York, New York 10018 | 
(212) 354-6100 
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Crome. COCTTA 

23% west L16 Street 

eu York, New York 10027 
(212) 200-4291 


i JACK GREENBERG 
10 Columbus Circle 
New York, New York 10019 


Attorneys for Plaintiffs 
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UNITED STATES DISTRICT COURT 


SOUTHERN DISTRICT OF NEW YORx 348a 
ae bee we ei a x 
BOSTON M. CHANCE, et al., : 
Plaintiffs, : 
- against - : 70 Civ. 4141 


(H.8.T.) 
THE BOARD OF EXAMINERS, AND THE 
BOARD OF EDUCATION OF THE CITY AFFIDAVIT 
OF NEW YORK, et al., : 


Defendants. 


. 
ee ee ee ee 


STATE OF NEW YORK ) 
: SS: 
COUNTY OF NEW YORK ) 


JEANNE R. SILVER, being duly sworn, deposes and says: 


1. I am one of the attorneys for plaintiffs in the above-captioned 


' action. I submit this affidavit in supsort of plaintiffs' motion returnable 


January 14, 1975, for an order (1) modifying the Final Judgment against the 


defendants Chancellor and Board of Examiners and the Order modifying the 


| preliminary injunction against defendant Board of Education entered herein on 


July 12, 1973, (hereinafter the "July 12, 1973 Orders") and (2) entering a 
Final Judgment against the defendant Board of Education; and in opposition to 
the defendants’ motion returnable the same day, to modify said Judgment and 
Order. I am fully familiar with all prior proceedings herein bearing on said 
motions. 


2. Defendants’ motion and the first part of plaintiffs’ motion are 


' similar, each asking the Court to approve as tne basis for developing a 


permanent new licensing system for school su>ervisors, a certain Plan which 
the parties praviously sxsmitted to the Court as the potential basis for a 
consent order, subject to resolution of two outstanding matters. Those two 


unresolved matters remain so at this time and account for important differ- 


' ences in the Plans each party is submitting to the Court. Subject to their 


_xesolution in the manner urged here, plainctiifs continue to balieve that the 


Plan Ex. "A" hereto ans fai summarized in paragraph of the affida 


' of defendant Murray Rockowitz, affords a sow:d basis for developing a con- 
stitutional new licensing systen. 39a 
3. The differences in the Plans* submitted by plaintiffs and 
i defendants are in the character of procedures proposed by each for reporting 
‘ on the development of a permanent naw licensing system (cf. Silver Aff. Ex. 
"A" Part V; Rock. Aff. Ex. "A" Part V) and their sesbectine approaches to 
i selection of consultants toe perform key steps in such development (cf. Silver 
‘ Aff. Ex. "A" pp. 6-7, 22; Rock. Aff. pp. 6, 22). The primary purpose of this 
affidavit is to explain the factual basis for our contention that defendants’ 
; reporting procedures and their attempted unilateral designations .= consulting 
t firms abrogate the condi: ions on which plaintiffs originally agreed upon the 
, Plan and violate both the Plan's intention and the July 12, 1973 Orders. 
| 4. As detailed in plaintiffs' memorandum of law submitted herewith, 
i and further supported by the affidavit of Dr. Richard Ss. Barrett, antiexed as 
i Ex. "B" hereto, defendants" proposed reporting provisions can only be 
i characterized as "minimal." Nevertheless, their motion asks authority from 
/ the Court not only to develop new supervisory examinations but to proceed to 
f administer tests and issue licenses based on them. Paragraph IX of the Court's 
i July 12, 1973 Orders pursuant to which defendants purport to have made this 
, Motion provides for development of a plan for a selection system. Paragraph 
) X provides for implementation of a system only after all parties and the 
'' Court have had an opportunity to review "all relevant data relating to the 
: new system and its development." Defendants’ motion and reporting provisions 
seem to seek authority to implement a new licensing system pursuant to Para- 
: graph X as if the developmental procedures and submission to plaintifis of 


relevant data it requires had already been complied with. tiotaing could be 


— 


farther from the truth. 


H *Review of the Plan as previously submitted to the Court indicates that there 
are some typographical errors ani also possible technical omissions in the 

| provisions for transition and ultimate administration of the new two-step 

‘| licensing system for which it Provides. We assume that any such problems will 

|| be correctible by agreement of the parties in connection with settlement of 

‘a £inal order and therefore, like defendants, have submitted the Plan in 

I exactly the form previously furnished to the Court, except for the contested 


Tod 


! 5. The only steps which defendants are known to have taken toward 
i! 350a 
development of a new systen, and certainly che only information they have i 


furnished to plaintiffs about such steps, is containeé in the Plan negotiated 


| by the parties. That Plan was conceived and remains solely as a set of guide- 
’ lines for the development of a system pursuant to Paragraph X of the July 12, 
! 
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1973 Orders. The need for extensiva deveiopmental work before a new licensing 


| 


| 
| 
| 
| 


i 

j 
i System can emerge is clear from the ciscussion in the Plan as well as the 
i 


assessment of plaintiffs' expert, Dr. Zarrett (=x. "3" Paragraph 4). 
6. While the Plan submitted to the Court is kelievad by plaintiffs 


to afford the basis for developing a sound, constitutional licensing system, 


it is no guarantor that such a system will emerge or that its guidelines vill 
be faithfully adhered to. It was for that reason that plaintiffs explicitly 


conditioned their assent to the Plan, when it was subsitted to the Court last 


May, upon the negotiation of effective resorting and monitoring provisions. 


polthaeleeedaelinion tearm a oie ee 


The provisions submitted by defendants reflect the breakdown of negotiations. 


+ mew 


As indicated in our Memorandum of Law, and affirmed by Dr. Barrett in his 


affidavit (paragraph 5) they fall far short of the recu.re “ O£ Paragraph X i 


| 
| 
| 
of the July 12, 1973 Orders and are totaliy inacecuate, in »-ur view, to safe- 
| 
| gQuar@ the interests of plaintiffs and the public in speedy aevelopment of a 


constitutional new licensing system. 
ia Plaintiffs’ second reason for opposing cerencants’ motion 4s 


the aporoach they have taken to the selection of consulting firms for prota- 


typical job analyses and validation studies required by the Plan. These 


fagks ava Of crucial imcortance =5 the cave.clmen= of 


sound Licensing 


yu 


'| system, since accuracy and sensitivity of job analyses are a prerequisite to 


; valid and job-related tests, while validation studies will determine whathe- 


:; the legal requirements of validity and job-relatedness have been met. For ! 


i} these reasons, and:particularly is. view of defendants’ past lack of success 


in gaining and using expert helo to make their testing job-related (Chance v. 


Boaré of Examiners, Opin. Mansfield, J., 339 F. Supp. 203, 213-19 (35.5.N.¥. 


1971), plaintiffs have consistently maintained that the selection of con- 


sulta:ts should be made either by defendants in conjunction with plaintiffs 


* 


impartial selection agency even more clearly apparent by their unilateral 
designation of firms in breach © ale understandings with plaintiffs. 

8. The affidavit of tie .xaminers' Chairman, Murray Rockowitz, 
is disingenuous on this point. Wnile it is certainly trie, as Mr. Rockowitz 
Sta that "blani:s" were left for the firms' names in the Plan submitted 
to the Court last May, the reason was not, as he implies, to vest sole dis- 
cretion in selecting cv.1sultants to defendants. The blanks vere left because 
the defendants were unwilling to nave a provision for divided jurisdiction 
appear in the text of the rublic document. Plaintiffs agreed to an informal 
arrangement whereby the parties would tr to agree to the firms in advance of 
the Plan's approvai, and a selection provision would therefore not be 
necessary. Blanks were included in the Plan so that names could be inserted 
when agreement had been reached and, as stated to the Court in May, the 


; defendants accordingly submitted to plaintiffs lists of firms under considera- 

ee 9. We have previously reported to the Court on the subsequent actions 
H ! 

“ of defendants not merely in selecting these consultants unilaterally but also 

in deliberately denving plaintiffs the opportunity to intervene or even 


influence their decisions. As reflected in letters annexé. as Ex. "C" hereto, 


the Board of Education ignored plaintiffs' repeated requasts fcr proposals 
submitted by the firms on its lists and then, having furnished a manifestly 


inadequate proposal from one of them at the last minute, proceeded t: avlect 
that firm at a publis: meeting over the slaintiff.' express objection. The 
soundness of that obtection in view of the proposal susmitted is confirmed 
by the affidavit of Dr. Barrett (Ex. "B", paras. 7, 8), whcse advice we cited 
in making it. (ix. “C-1,27) 

10. The defendant Board of Examiners declined to furrish any 
| proposals submitted by organizations which it considered as consultants to 
do the validation studies. Csrressondence witha one of the organizations 
on its list (Ex. "'" nerete) conzirms that it also advised its bidders not to 


cooperate with our inquiries despite having assured us previously in open 


en ame v0 


Court that we were welcome to communicate about the project with the firms 
| Cn its list. Finally, at the Decembe bh : ee Pas eet aes 
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counsel advised plaintiffs and the Court that a firm had heen selected. 
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ll. Plaintiffs resvectfully submit that the breakdown of negotia- 


tions with defendants over reporting rrovisions, the minimal hacacter of 
the provisions they have included in their Plan and their determined conceal- 
ment of the basis and underlying data upon which the selection of consulting 
firms was predicated all confirm th2 necessity of the detailed reporting 
provisions and consultant selection procedures included in our Plan. The 
manifest intention of Paragraph X ci the July 12, 1973 Oxders is to assure 
that before a new licensing system is implemented ground shall have been 
established for confidence that it will be valid and constitutional. Instead, 
the recent conduct of defendants has engendered doubts of the sincerity of 
their purpose. Provision for effective advance reporting on the licensing 
system's development and a guarantee that competent and impartial consultants 
will be selected for vital tasks ere minimum safeguards against defendants' 
continuing their past pattern of repeatedly developing invalid, non-job- 
related tests. Chance v. Board of Examiners, supra, 330 F. Supp. at p. 223- 
12. The second branch of plaintiffs' motion asks the Court to enter 
a Final Judgment ~ “ing permanent the Preliminary injunction against tne 
defendant Board of Education as modified by the Court's July 12, 1973 Order 
against the Board. Plaintiffs have moved for that relief in view uf the 
Court's expressed interest in resolving outstanding issues in this litigation 
and view it as an essentially technical request to which we hepe the Board 


will consent. 
13. The Preliminary injunction ané the Final Juégment nexein are 


identicel in substance. The absence of a final order against the Board of 
Fdication resulted from its unwillingness, despite having Zailed to defence 
the action, to consent to the settlement reacned by the Board of Examiners 


and Chancellor. (Order against Board of Education July 12, 1973) In April, 
1973, the plaintiffs moved for a cetault judgment against the Board of 


Ed@ucation or in the alternative for modification of the preliminary injunc- 
tion, and the Court granted the alternative relief, effective pending final 


‘& 
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' Order against it resulting from the pending motions of plaintiffs and 


5 
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14. It is certainly clear now that the Board of Educaticn does not 


plan to go to trial on the merits herein and that any modification of the 


: defendants to modify the July 12, 1973 Orders should be permanent in effect. 


It would be senseless, under the circimstances to continue or further modify 


the Preliminary Injunction against 


that the Final Judgment and any modi 


on all parties to this action. 


WHEREFORE, plaintiffs res 


the Board, and plaintiffs therefore submit 


fication thereof should be made binding 


pectfully request that plaintiffs‘ motion 


returnable January 14, 1975 be granted and defendants’ motion returnable on 


said date be denied. 


Sworn,to before me this 
2/ gay of a 1975 
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Qua'.tved in few Yors Counsy 
Commission Expires March 30, 1978 
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JEANNE R. SILVER 
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Plan Proposed by the Board of Examiners, 

Board of Education and the Chancellor, 35ha 
for Licensing Supervisors in the New 

York City School System. 


yV 
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Introduction 


This proposal outiines a procedure for the develop- 
ment of examinations by the Board of Examiner's to fullili 
4ts statutory responsibility to provide examinations for the 
licensing of supervisors on the basis of "merit and fitness" 
through the use of “open qualifying” examinations. To achieve 
this objective the proposal provides for: 
(1) Job analyses of all supervisory positions; 


(2) Development of job-related examinations which 


shall consist of the following essential steps - — 


Step 1 shall consist of 2 comprehensive assessment progran, 

whose results shall be scored end reported in a manner more 

useful to the new Community School Board type of administra- 
~ 


tion and which shall result in the provisional licensing of 


all eligible applicants except those who fail to meet levels 


Q 


of minimum accep able performance. 


Step 2 shall consist of an on-the-job performance evaluation 
of persons who have served with provisional licenses, and 
shall result in the permanent licensing of those found to have 
performed reasonably. 


(3) A procedure for validating examinations. 


The goals of the proposed program are: 


(1) to develop non-discriminatory personnel 


s 

jo 

=3 
2 


selection policies without abandoning the essential elements 
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of a merit systen,; 


(2) to build in performance evaluation as a 
key component of the licensing process; 
(3) to insure employing authorities a broad 


choice among gualified applicants. ‘ 


Accordingly, the primary purposes of the Board of 
Examiners' evaluation at Step 1 are to screen out those who 
fail te meet levels of minimum acceptable performance, and 
with respect to all other applicants to provide community board 
and Central Board of Educetion hiring authcrities with the maxi- 
mum useful information possible so that they will have an in- 
formed basis for making decisions regarding the selection of 
those most highly qualified for service in their particular 


schools and districts. 


I. gob Analysis . 


| Se 


1. The Board of Education, in consultation with the 


Board of Examiners and cther interested persons and groups, 


ann ne iets iia a areca tenia aaa 


will develop job analyses for all positions for which the 


serene nierhinacnmaeonens 


Board of Examiners is required to conduct examinations. The 
job analysis will be based on a determination of the job 
behaviors which include the tasks the person is called upon 

to perform, the amount of time devoted to these tasks, their 
relative importance, and the knowledge and skills which enable 


| a person on the ,ob to perform these tasks successfully. The 


proposed procedure should be viewed as a model for analyzing 


cy srermnecnn om 


all jobs although specific procedures might differ for specific 


™ ey 
° 
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jobs. 
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As a general rule, the job analysis will be developed 


from data which will be accumulated in the following way: 


A. One resource in developing the job analysis 
will be analytic descriptions of the handling of 
such jobs by incumbents presently serving in such 
positions. To utilize this resource observers 
selected by the Board of Education who have a back- 
ground in the specific license area and/or are 
trained in job analysis (could be non-pedagogues) 
will be trained and periodically retrained in 
observation techniques. These observers will 
visit school sites to observe incumbents in the 
position to develop descriptions of the work they 
are performing. Sufficient numbers of all-day 
visits will be made to the schools over repre- 
sentative periods to insure that the description 
includes both daily and periodic tasks. Observers 
will be required to record all tasks performed by 
incumbents indicating not only a description of 
the task but the time allotted to each and to 
indicate the relative importance of the described 
behavior in terms of effective verformance. To 
insure that the analysis includes consideration 
of the widely varying schools and districts in the 
City of New York, the sampling will include in- 
cumbents in schools located in districts of varying 
socio-economic levéin. Any other steps necessary 


fo assure meeting the differinz needs of various 


\ 
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districts will be fully considered. 

B. Observed incumbents will be asked to 
provide the Board with a log of their activities 
in the job. 

C. Incumbents' lozs will be compared with the 
observers' logs developed in accordance with (A) 
above. The incumbent's supervisor will evaluate 
both the observer's log and the incumbent's des-— 
cription to determine the relative importance of 
the described behavior in terms of effective per- 
formance. The job description will incorporate 
observed and reported dat2, together with the super— 
visor's judgments. 

D. The Chancellor, Community Superintendents, 
Community Schoo] Boards and/or Parent Associations 
will be consulted es to tneir perceptions of the 
job. Such perceptions shall be considered in the 
development of the job description. 

E. As a further effort to insure the soundness 
of the job analyses, the Board of Education will 


‘ 


subject each analysis to review by the following: 
1. A Community Superintendent or Central 
School Superintendent. 


2. A college or university specialist 
in the relevant area, 


3. A personnel specialist from outside 
the New York City School System. 


4h. An = incumbent Supervisor in the relevant 
category. . 


~~ 


Ba 


5. A Community School Board representa- 
tive designated by the Chancellor. 


Where there is an appropriate group which is rep- 
resentative of any of the aforesaid categories, the Board 
will seek designees from such group. However, the final 
selection shall be by decision of the Board of Education. 

The designees shall review each jot analysis and 
shall make recommendations to the Board concerning same. The 
decision of the Board of Education, however, shall be final. 

2. Based on the date developed in "1" above, the 


Board of Education shall prepare a job analysis and descrip- 


tion for each position for which examinations are to be con- 

ducted. This job analysis shall set out and fully elaborate | 
all of the important qualities and/or behaviors necessary for 
performance of the job. It shall also indicate the relative 
importance of the various qualities and behaviors and the de- 

gree of significance each has in determining overall effective 
performance. In drawing up these analyses the views of in- 
cumbents, their supervisors and those persons consulted pursu- 

ant to "D" above, as well as pertinent research literature 

shall all be taken into account. 

The Chancellor and the Board of Education will also 
utilize the process of develoning jo» analyses to r2vieuw 
existing job titles, combining titles and/or creating new 
titles, where appropriate. 

As a further aspect of preparing job analyses every 
effort will be made to identify common elements in jobs which 


might lend themselves to assessment in a common test. Similarly, 


in utilizing job analys-s every effort will be made by the 
359a 
Board of Examiners to identify common elements in jobs which 


might lend themselves to assessment in a common test. 
In order to insure broad public acceptance as to 


the objective implementation of the procedures set forth 
herein and in "1" above the Board of Education will retain 
a recognized consulting firm to develop and prepare the first 


three job analyses as prototypes sursuant to the procedures 


set forth herein and in "1" above and/or such other proce- 
dures as the firm deems appropriate. The prototype analyses 


shall cover the positions of Principal- Elementary School, 
Assistant Principal - High School (Supervision), and Assistant 


Principal - Elementary and Junior High. These positions 
cover the largest number of people in the supervisory cate- 


gories, thus permitting the program to start ina meaningful 
way. These analyses will thereafter serve as models for 
future job analyses to be developed oy the Board of Education. 
In doing these analyses the consulting firm shall be guided 

by the goals described supra of identifying common elements 

4n jobs which might lend themselves to assessment in a common 
test, and of reviewing existing job titles with a view toward 
making recommendations to the Chancellor and Board of Education 
regarding the combination of titles and/or creation of new 
titles, where appropriate. The consulting firm shall also 
recommend a program for the selection and training of persons, 


to conduct subsequent job analyses. 
The consultant designated to develop the prototype 


job analyses shall be selected cy @ panel composed of 3 men- 
bers including one chosen by the defendants herein, and one 
chosen by the plaintiffs. A third panelist, to be chosen by 
the Court, shall be a member o* the faculty of a law school 

in the New York metropolitan area who specializes in personnel 
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The panel shall also choose the consultant to be 
designated to perform v2lidation studies pursuant to Section 
III hereof. 

In choosing the consultants, the panel shall be free 
to consider any firm, organization or individual recognized 
as expert in employment selecticn and testing, including but 
not limited to those recommended by the defeidants and/or 
plaintiffs. Selections-shall be made only after proposals 


submitted by each firm under consideration have been submitted 


to plaintiffs and defendants an= they have oveen afforded 
opportunity to confer with the firms regarding their proposals | 
and transmit their comments to the panel. | 
The panel shall be appointed within 10 days of the 
date of an Order by the Court incorporating this Plan, and 
shall make its selection of the consultant for job analyses 
no later than 4 weeks thereafter. 
The Board of Education, in its discretion, may use 
consultants to perform services in the development of future 
job analyses. 
3. The Board of Examiners will determine the feasibility 
of the development of tests for families of jobs that require 
similar qualities and behaviors. It would then be possible 
for similar tests to be administered for a group of jobs that 
call for similar knowledges, skills and behaviors. The Board 


of Examiners, in its discretion, may use consultants to per- 


II. Job-Related Examinations 36la 
The Board of Examiners will develop examinations 
based on the aforesaid job analyses which measure the appli- 
Gent 'c capacity to perform the significant job requirements 
as indicated by the analysis. Tnis examination process will 
be divided into two steps. Step 1 will consist of a series of 
tests to be given to all eligible applicants for the primary 
purpose of evaluating the aprlicants' strengths and weaknesses. 
All persons who meet levels of minimum acceptable performance 
under Step 1 shall be declared eligible for provisional appoint- 
ment to the position in question. Step 2 of the examination 
process will be administered to those persons who secure such 
provisional appointment. It shall consist of an on-the-job 
performance evaluation at the end of one school year of pro- 
visional service. Any person found to be performing reasonably 
in the Step 2 evaluation shall be awarded a permanent license 
for the position in question. 
A. Description of Step 1 Tests 

A variety of tests may be used at this stage. 

They may or may not include written examinations, depending on 


the needs of the particular situation and the nature of the 


qualities being evaluated. These Step 1 tests are likely to 


include some combination of the following: 

1) Situational tests or job si ‘lations - 
tests which place the applicant in a realistic 
job setting and call upon nim to eavibit appro- 
priate beh: vior. Thus, if administrative ability 
is a job requirement, an in-basket test may be 


used. This test uses a hypothetical but realistic 


in-basket containing letters, memoranda, records 
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of incoming telephone c2lls and other documents 


normally found in the in-basket of the school 
administrator. The applicant is given the 
necessary background information concerning the 
school in which, as principal, he would be faced 
with the specific in-baszet. He is told that he 
4s the incumbent princip21 and that he must re- 
spond to the materials és he would actually respond 
on the job by 
a) handling certain matters himself immediately 
b) handling others himself at a later time 
c) delegating some to staff for immediate 
action and 
d) delegating others to staff for later action. 
After a period cf study of the documents, 
he may be asked in an interview to give the 
reasons for the decisions he has made in 
handling the in-basket and to defend them. 
2) Job knowledge tests - written and/or performance 
tests which measure the applicant's knowledge of 
subject matter required by the job. Thus an appli- 
cant for the position of Assistant Principal 
Supervision (Mathematics) D.H.S. -mignt be required 
to demonstrate a knowledge of the curriculum and 
materials of his subject to the extent that the job 
analysis identifies that knowledge as important to 
the performance of the job. 
3) Tests of communication skills - written and/or 


oral tests which will reauire the applicant to 


demonstrate his aOF8 sty to write and speak effec- 

tively to students, staff, parents and the community. 

4) Tests of special experience - tests designed to 
give an applicant the opportunity to demonstra2te his 
knowledge of special areas that may be deemed impor- 
tant by particular Community School Boards, @.g-,; 
knowledge of a foreign language. or knowledge of the 
culture of a particular ethnic group. 

5) Physical and medical test. 

6) Inspection test - evaluation of the performance 
of an applicant on the job currently held. Every 
effort will be made to include such evaluations in 
the Step 1 assessment, although considerations of 
cost may preclude extensive pers cemence evaluation 
in some examinations involving large nuaber of 
applicants. 

In order to insure that tests are job related, they 
will be created by closely matching the tests and test tasks 
to the important elements of behavior ou the job as identified 
in the job analysis. The jod analysis will be reviewed and 
selected behaviors listed will be translated into test tasks. 
The sampling of test tasks will .‘eflect in microcosm the com- 
plex conditions of the job itself. Each test item in a written 
test and each test, be it interview or simulation, will be 
identified by a code referring to a specific item on the job 
analysis. This cross reference system will insure that test 
tasks used will be based on the job analysis. Test items will 
reflect the relative importance assigne. to the task in the 


job analysis. 


| 
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B. Reporting of Results of Step 1 36he 
In the past, specific weights were attached to 


each one of the tattery of tests with a few exceptions (written 
English, physical and medical, and records were rated either 
satisfactory or unsatisfactory). A candidate had to achieve 2 
weighted average of 60 per cent on the battery of tests to 
pass. If a candidate scored less than 50°per cent on any pars 
of the examination, he was eliminated. If he obtained 50 per 
cent or more, he was continued in the examination but he had 
to compensate for marks lower than 60 per cent because he had 
to achieve a weighted average of 60 to pass. 

To adapt the testing system to the needs of . 
Community School Board type of administration, test results 
will be reported in a manner completely different from hereto- 
fore. Instead of a composite grade, a profile of perforzance 
will be made available to the Central Board or to Community 
School Boards, whichever has jurisdiction, for each qualified 
candidate. This profile will present an assessment of the 
performance of each qualified candidate in all tests without 
specific weight and without exact composite numerical grades. 

The assessment will also include a narrative 
report of the candidate's performance in the various areas 
tested as previously determined by the job analysis. For 
example, the assessment of a candidate in a principal's examin- 
ation might report on the following areas: 

1) managerial abilities (e.g., handling of 

a variety of problems by proper organization, 
planning, imagination and decision-making); 
2) supervisory abilities (e.g., competency 


to observe classroom teaching insightfully and 


% 


to contribute t> tne improvement of teacner 
r 


per formance) ; 


«) 


3) interpers 
munications ski.i 
participants in 4 
the human factors 
The standards for 
test will be establishes <=: 


Examiners in the areas cc’? 


therewith will be made by ex 
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drawn from a pool of exper: 
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assistant examiners and ex 
sonnel, from the varied rea: 
in the New York community;’. 
in accordance with a scorin 
significant elements in ths 
acceptable performance bess 
Similarly, in a@ s 


the level of minimum acts: - 


121 relationships (e.g., com- 


1, sensitivity to the role of 
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-itsis situation, awareness of 
crerative in a school setting). 
assessment of performance on each 
“ts chosen by the Board of 
and assessments in accordance 


e-iners chosen for their expertise 


. Thus, in evaluating per- 
"2 in-basket, examiners will be 
22 administrators in education 


articipated in the job analysis or 
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‘t+n the adminstrative component of 


~trstion assistants qualified per- 
i21 and ethnic groups represented 
Tre examiners will rate performance 
z guideline that will identify the 


-basket and levels of minimum 


i 
re 


4 on the guideline. 


upervisory simulation, standards and 


pooling expert opinion of chose who had wide experience in 


supervising instruction in 


2 variety of schools and wh? were 


thoroughly familiar with tne content and methodology of the 


curriculum areas involvec. 


If 


Trey would view - representative 


ficant areas of strength 


and weakness in the perform: 


the lesson and specific ways 


be improved. gs, 


The candidate i: 
university professors or oth 
with the specific subdj 


+A 


and present a program he wou 
the teacher's performance. 


No assistant examiner 


nee 


A sample profile form::+ 


G2 the teacher conducting 


wnich that performance could 


a 


aopear before one of a number 


“e- 


school supervisors, 


fai) 


sae oe 


ts in supervision familiar 


2 “ould evaluate the lesson 


cos 3° 
“To: 


to implement to improve 


-~m 


Pees 
a7 
~ 


amination assistant shall 
any test without having 


i 4 


Sllows on the next page. 


Sample Assessment Profile Format 


(The tests indicated are re 


examples of those which 
might be used. Total ass . 


is not restricted to 


vg 


these examples.) = © 2: 
0 & > cs 
c - = 
fo | ee pte pe 
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SEEEEe ee ea 
Understanding of Essential Pr 
of Administrative Behavior 
(as measured by "“in-basret" 
situations) 
eae ne a i 
Ability to Evaluate 

Observed Classroom Teaching and to 
Eifect Improvement 

(as measured by response to actual 
teaching) 


Understanding of Human Relations 
Principles Involved in Schosl 
Management (as revealed by reaction 
to taped situations) 


nt tenets 


Understanding of the Educationa 
Process in the Urban petcineg 
(as revealed in a written tes t on 
educational literature -— for entry 
level as chairman or assistent 
principal) 


Communications Skills: 
Communicate to meatt, Bt: 
Community 


(as revealed in simulated tasks 


Al 
u 


od 


Skills in English Communication 
(as revealed in a writing ser dl 
entry level as chairman or assi 
principal) 
eee on 
Inspection Test 

Physical a and Medical Test 
Record, Including character 
evaluation of past experience 
(including fingerprint check required 
by Board of Education) 


meena ee etenaenantnssearesnesrtnesitenao, 


special Skills Tested at Appi icant's 
Request (e.g., knowledge of Spanish) 


$a 


Special Experience 
(identified from vita supplied by 


applicant and verified by the Board 
of Examine 
4 Re 


368a 
It can be seen from this sample profile that, 


though the candidate is qualified overall, he is unqualified 
in one of the areas tested. In the event that the perrormance 
or the applicant is determinec not to meet the level of 
minimum acceptable performance in an area deemed essential 


by the job analysis, he would be rated unqualified and not 


recommended for licensing and 2 place on -the qualified list. 


cr 


This level of minimum accep ormance shall be set 
with a view toward screening out tne unqualified, consistent 
with the primary purposes of the Step l evaluation which are 
to ensure employing authorities the broadgest possible choice 
among qualified applicants, and to provide with respect to 
such applicants the maximum useful information possible so 


that the employing authorities will have an informed basis 


for making decisions regarding the selection of those most 


tJ 


highly qualified for service in their particular schools and 
districts. A rating of unqualified in one or more arees noc 
deemed essential by the job analysis would not prevent t: 

applicant from being placed on the qualified list, although 
said ratings would of course ve reflected in the applicant's 


assessment profile. 


Upon receipt of the 1’st or qualified eligibles, 


J 


together with their assessmens profiles and narrative report, 
each Community School Board couls evaluate une Enalcaces 
achievement levels of each eligible in the lights of its 

own needs, attaching more impr reance 0 some aspects of the 
total assessment and less importance to others. Thus, a 
candidate who did poorly in English communication but well 


in administration and supervision might be more acceptable 


. 


+ 
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to one Community School Board than to another. Another 
aspect of the profile would co2 the evaluation of additional 
skills claimed by the applicent; thus, an applicant who 
claimed fluency in Spanish wioula be tested for that skill 
and this additional qualification will be reported together 


e 


with the other aspects of his asseseinent. 
The Board of Examiners would eae hace to 

rovide a manual to help Community Senhool Boards interpret 
the results reported and would consult upon request with 
any Community School Board in metters of personnel 
selection. Further, in the c2s2 of applicants whose assess-— 
ment profiles did not include edesuese evaluations of Geico 
performance, the Board would provide additional assessm 
service. Each Community School Bo2rd could submit to the 
Board of Examiners a list of reasonzale length of quaittic? 
persons in whom they were interested for a particular 
Supervisory position, for an assessment of their performanze 


in the job they currently hold. The Board of Examiners 


ion by a team of 


cr 


would evaluate by an on-the-site inssec 


experts each eligible as to performance in his current g00, 


toe 


wherever he may be serving, end submit a report OF its 


> 


findings to the Community School Board. 


minations 


C. Frequency ¢* S%45 1 Exe 
and Establisomert of Continuing 
Fligible Lists for Persons With 
Provisional Licenses 
the parties agreed +o, an: any settlement agree- 


ment is conditioned upon, the entry of a remedial order by 


the Court providing that, in order to maximize the opportunity 


. 


for qualified minority applicants tc compete for supervisory 


positions: 


otto, 


a. The Step 1 Screening process for any particular 
examination shall be completed as Guickly as is administratively 
feasible. 

2. Step 1 examinations for every separate job 
title for which there are vacancies shall be ordered by the 
Chancellor in connection with the Community School Board 
Consultative Council as freguently as it is administratively 
feasible for the Board of Examiners to give such examinations 
and it appears appropriate, in order to insure employing 
authorities the broadest possible choice of qualified appli- 
cants. In any event, said examinations shall be ordered and 

ven whenever the number O> persons with provisional licenses 
On an existing list falls to 50% of the number on the list 
at the time of its establismnent. 

3. Successful cansicates for provisional licensure 
Shall have their names addec to, and shall remain on, eligible 
lists for a period of four Years. 

The provisions of paragraphs"1" through "3" above 
Shall be effective for a period of 5 pene from the date of 
the announcement of the las¢ prototype examination, notwith-— 
standing any provision to the contrary contained in any 2a, 
regulation or collective bargaining egreement, including 
Specifically N.Y. Educ. Law § 2590-3 .42(f). 

Tne announcement of examinations by the Board of 
Examiners shall not precede the giving of such examination 


by more than six weeks. 
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omy 


Phasing Out of 


On Basis of Parr ormance Evaluation and of 
Interim System of 


Interim System of Licensing 


Filling Vacancies 


1. With respect to eacn Supervisory job title, 


the interim system of licensing 


evaluation established pur: 
July 12, 


until: 


examination for 
Examiners at which 


of evaluation 


cease, 


eligible fo 


1973, shall contin: 
a) The promulga 


provid 


bam) 
A te 


on the basis of: performance 
ant to this Court's orders of 

¢ in effect for each job title 
tion of an announcement of an 
chat title by the Board of 
time the interim system 
for such title shall fort hwith 
ed, however. that,all persons 


ormance evaluation whose 


applications for such evaluation are filed 
prior to the date of seid announcement, shall 


be evaluated 


pursuént to the interim system 


of performance evaluation and, where 


appropriate, 
If no announc 


b) 


any. particular job 
of performance evaluation shall 


= 


Pacer OL cA 


is made for 


licensed. 
ans 


ment of examination 
title, the interim system 


cease on the 


(1) The expiration date of any existing 
G@lleio = 2 2s0 2cy Daccicules JCD §261e o2 
(2) one year from the date of the announcement 


by the Board of 


the aforems 


Examiners of the last of 


ntioned three prototype 


examinations. 


Notwithstanding the foregoing provisions of this 


subparagraph (b), 


-all persons eligible for performance 


evaluation whose applications are filed prior to the 


“> 


> 
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pursuant to the intcrim system of performance evaluation and, 


where appropriate, licensed. 

: 2. Pending the promulgation of a list of persons 
provisionally licensed for a particular job titie pursuant 
to Step 1 hereof, vacancies in such title shall continue to 
be filled in accordance with tne provisions of Paragraph VIII 
Or the duly 12, 1973 orders of this Court, provided, however,” 
that licenses sh2ll not be granted to persons filling such 
vacancies in accordance with the performance evaluation 
procedure except as provided in paragraph "1" above. 

3. Upon promulgation of a list of persons 

provisionally licensed for a particular job, title pursuant 
to Step 1 hereof, the interin system of appointment to 
positions in such itie described in Paragraph VIII of the 


orders of July 12, 1973 shall forthwith cease. 


E. Description of Step 2 Test 


This step shall consist of on-the-job performance 


evaluation, after one school year of service, of any person 
given a provisional appointment after qualifying under Step 1. 
A candidate will be rated satisfactory under Step 2 if he 
demonstrates reasonable performance on the job and will 


then be awarded a permanent license for the position in 


question. 

The on-the-job evaluation will assess the candidate's 
performance in terms of the essential elements of tne job 
analysis through such activities, for example, as the following: 
Classroom visits and a study of the applicants' efforts to 


improve teacher performance (e.g., post-observation 
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conferences and reports, workshops, inter-visitation progran, 
and demonstration lessons); interpersonal relations with 
staff and students (as evidenced, e.g., in staff meetings . 
consultative council meetings, and meetings with student 
government officers); relations with parents and community 
(as evidenced, e.g., in planning parent meetings, in 
involving community persons in advisory Ca0acities, in 
using community resources in the instructional program) ; 
discussion with the applicant and his supervisor concerning 
the goals of the school, major problems that the applicant 
has faced in achieving these soals, and steps he has taken 
to solve these problems and provide a wholesome school 


environment and an effective instructional program. 


The panel conducting the evaluation will, in 


assessing the applicant's performance, consult with a broad 
cross-section of persons familiar with the applicant's work. 
For example, in the case of an elementary school principal, 
this would normally include the Candidate's supervisors, 
his fellow administrators, teachers working under him, 
Students and parents, as well as any persons designated by 
the community superintendent or the community board. 

F. Staff 

The Board of Examiners shall have as a major goal 
the development of a full time, permanent staff of persons 
drawn not only from education, but from such other fields 
as testing and measurement and private industry, as well as 
the use of examination assistants from outside the educational 
profession. The Board shall develop and puhlish ‘appropriate 


written selection criteria for both assistant examiners and 
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examination assistants and shall develop appropriate 


training procedures for such staff. 

No member of the staff shall participate in the 
administration of any test without having first received 
appropriate training. Both assistant examiners and 
examination assistants shall include, where available, 
qualified personnel from the varied racial and ethnic 
groups represented in the New York community and from 
outside the education profession. Nothing contained herein 
shall be deemed to contravene the provisions of Section 2659 
of the New York State Education Law regarding the nomination 
or approval by the Chancellor or Community Superintendent of 
examination assistants. 

G. Appeal Procedures 

The program described above will continue the 
same safeguards that are currently in effect, namely, the 
right of the applicants to full disclosure of the guidelines 
used in the assessment process with the right to appeal from 
any or all of the findings at both Step 1 and Step 2. Such 
appeal shall be made in accordance with Section 13 of the 
By-Laws of the Board of Examiners (copy of which is attached 
hereto) and may chailenge any aspect of the examination 
including whether the examination is consistent with the 
general standards and procedures for testing at Step 1 and 
Step 2. 

The Board of Examiners will apprise applicants 
of their right to appeal, of the procedures to be followed, 


and of the procedures available to obtain review of any 


appeal denied by the Board of Examiners. 


III. Validation 375e 
The Board of Examiners will develop procedures to 
validate Step 1 and 2 and the testing program on an on-going 
basis. in order to assure that these validation procedures 
are properly developed and performed, the Board of Examiners 
shall designate a firm or organization selected in accordance 
with the procedures for selecting a consultant to perform job 
analyses described in Section 1.2, supra, as its consultant 
or consulting agency to design and conduct validation studies 
of the examinations for the three prototype positions referred 
to in Section I supra. In carrying out its task the consultant 
or consulting agency shall be directed to design and implement 
validation procedures which are consistent with applicable law. 
The procedures so developed will serve as a model for subse~ 
quent validations, as appropriate. 
The testing process snall be revisec as necessary 


to make it consistent with the findings of the validations. 


IV. Licensing Procedure 


Candidates who are found to be qualified as a result 


of the Step 1 procedures described above shall be placed on an 


"eligible list” promulgated by the Board of Examiners and 


certified to the Division of Personnel of the Board of Educa- 
tion. Persons on such a list shall be eligible for provisional 
appointment to the jobs for which they have been tested. Once 
such a list has been established, appointing authorities shall 
be free to fill supervisory vacancies with persons who possess 
such provisional licenses or with persons who possess licenses 
granted pursuant to the interim system of performance evalua- 
tion or with persons who possess licenses granted pursuant to 


the previous system of examination. 


appointee must be evalu 
Those candidates found to have 
accordance with the Step 2 on- 
above, shall be licensed. The 


completed within the semester fc.i90 


year of provisional service. 
v. 


A. 


Defendants shall 


fe bast 
any of the three 
having obtained 


wa 


approval by the Court pur 


« 
~ haa 


REPORTING AND MONITORING Ficyie 


REFORL ING ANY OS 


atin 
ont 


fo 


r the provisione. 


Step 2 hereof. 
satisfactorily in | 
valuation descrised 


‘aluation shall be 


the required school 


ster Step 1 tests for 
positions until after 
by the plaintiffs and/or 


suant to the procedures 


described in paresr2on X of the Final Judgmers 
entered by this Cour: on July 12, 1973. Fricr 
to applying to the 7Vourt “or permission to proceec 
with tests for eny position, they shall have 
furnished the follewing information with respect 
thereto to plaintiffs and the Court as hereinarter 
specified: 
a. Job Analyses 

(1) Before undersaxing job analyses for any oF 


the prototypicél posit 


tion will furrisa 


tS 


inp 4 


—wM ve 


written descr on 


ing (ire o 
this description 


things, 


specifi 
manner in whicn the 


objectives anc 


by 


shail include, among 


resuirse 


tons, the Board of Educa- 


laintiffs' counsel a fui 


rn 
ug 


the designated consult- 


follo 


ie 5 


other 


ec information regarding the 


firm will carry out tne 


ments of Parts I.1 and 


jucation will obtain from the 
urnisn to plaintifts' counsel 
1 summaries, studies end 

reports generated in the course of conducting the 
job analyses for any of the prototype positions, 
including Sut not limited to the final report and 
analysis and the program recommended by the firm, 
pursuant to 1 te Ii2@ of the Plan, for the 
selection and training of persons to conduct 


subsequent job analyses. 
Development of Tests and Evaluation Procedures 


Not later than six weeks prior to an applicatior 
for court approval of the holding of Step 1 tests 
for a prototype position, the Board of Exeriners 


will provide plaintiffs' counsel with 
(1) a full and detailed description of each Step 


tep 2 evaluation procedures 
data and studies showing 

the basis for concluding both that the component 
parts of each s? and the licensing process as 
a whole are valid and job-related; with respect 
to Step 1 tests, such information may include 
the full text of actual tests to be given but 
need not do so if adequate samplings of tests 
and test questions are provided to indicate 
specificalli; aAow t: tests are related both to 
the job analyses and proposed Step 2 evaluation 


nagijya 
& fotos BON Begg... 


3 
descrintion showing racial and ethnic com- 


position anc educational and professional back- 


ground of the pool of examination assistants 


2. 
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description o 


vrocedures to be followed in 


r Stes 2 evaluations. 


Promulgation of Results 

Defendants shall not scromulsate the results of either 
Step 1 tests or 
positions or issue citner provisional or permane:- 
licenses based <nereon less than 3 weeks after having 
submitted to plaintiffs and the Court the following 


information: 

&®. With freapec: cs Ste: i vesults oniy: 
(1) Copies of the tests, if net previously fur- 

nished, with ccptes of scoring guidelines, 

assessment rrofiie format and manual for use cf 


profiles to be furrished to appointing autrorities. 


b. With respect tc Stes 1 and Step 2 results: 
(1) A report on ¢h2 race and ethnicity, anc 
educational ané orcZessional background of the 

respective grouss cf examination assistants wns 

actually administered the examinations and 


evaluations. 
(2) A report on the race and ethnicity (biack 


Latin American, ‘whicte) of applicants who applied 
for, completed, cassed and failed the examina- 


tion or evaluation respectively. 


(3) A list of rerscns wno failed the examination 


or evaluaticn with reasons for failure of eacz. 


(4) A copy of the rotices given to applicant 
regarding tneir risgnts of appeal from examine- 


ton or ev2lustion results. 


Court a report 


successful anc 
6b. Other Examinations 


1. Defendants shall not 
tests for any non-or 
no eligible 

pursuant to this 
based thereon, u 
furnished to plain 


of data with respe 


tion and results 


ment of Step 2 evaluati 


tion, required 
nor shall defendants 
evaluations for such 


licenses therefor unt 


“ 


furnished plaintiffs 


types of data rea: 


i¢fs' counsel and the 


e and ethnicity of 


unsuccessful appellants, respectively. 


romulgate the result of Step 1 


1 position for which 


been established 


the Court the same types 


to the development, administra-— 


“ 


and with respect to develon- 


to prototypical examinations; 
gate the results of Step 2 
vions or issue permanent 
three weeks after having 
respect thereto the same 


Part V.A.2 supra in regard 


to the results of evaluations for prototypical 


positions. 


Immediately following the resolution of enppeals 


fron 


Step 1 tests anc Step 2 evaluations, respectively, 


defendants shall report to pleintiffs' counsel on 


race and ethnicity 


successful and unsuccessful 


In addition to any validation studies furnished in com= 


pliance with Part V. A and B, defendants shall furnish 


« 
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fs' counsel, as soon as they are develoved, 


Sata required by the Plan: 


tne following 


(a) #12’ validation studies and description of 
placned or recommended procedures for validat-— 
ing Step 1 tests and/or Step 2 evaluations 


referred to in Part III of the Plan. 


(b) Any other validation studies of any super- 
visory examination or evaluation performed while 


these reporting provisions remain in effect. 
D. Information on Staff Development 


With 3 months from the date of the Court's Order and semi- 
annually thereafter for as long as these reporting pro- 
visions remain in effect, the Board of Examiners shall 
submit a report on its compliance with the provisions of 


Part II.F of the Plan. 
The defendants shall furnish to Plaintiffs' counsel as 


they are developed reports of all such studies conducted 
wy themselves or consultants pursuant to Parts T.é and 1.3 
ef the Plan. In addition, within 6 months after receiving 
zny such report, they shall report further to the Court 
and plaintiffs' counsel on actions taken to comply with 


4ts recommendations. 


F. information Regarding Frequency of Step 1 Examinations 
Beginning three months after the establisnment of the 
first list of provisional licensees promulgated pursuant 
to Part I.C. of the Plan and for the duration of these 
reporting and monitoring requirements, defendants shell 


furnish to plaintiffs' counsel a quarteriy report on the 


381a 
“ suck lists have been promulgated to date, setting forth 


the numbers of persons who have applied for Step 1 tests 
for each sinc? promulgation of the list; the date of any 
subsequent Step 1 examinations held or scheduled and if 
none, the reason why not; the extent to which each list 
has decreased in number since promulgation; and other 


information bearing on defendants! compliance with Part I.C. 
Other Information 


The defendants will provide the Plaintiffs’ counsel with 
Such other information as is reasonably necessary for 
them to make a determination regarding compliance with 
the Court's Orders and/or the validity and gob related- 
ness of any test, and will furnish the information 
required by Part B.1, supra, at earlier times than those 


etre Tenement 


presented, provided that: 


(a) plaintiffs' counsel give defendants reasonable 


written notice of the information required; and 


(b) the information reauested is relevant to a 
determination concerning compliance with the Court's 


Orders. 


Record Keeping 


Defendants shall retain all underlying data and other 
records, reports, resumes of oral reports and other data 
bearing on implementation of the Plan and/or other 
matters covered by this Section for so long as these 
eperting anc monitoring provisions remain in effect. 
All such records shali be subject to inspection by 
plaintiffs' attorneys in accordance with the provisions 


of Part V.G. SU0T 


tee a seem ao 


Protective Orders 382a 
Nothing herein shail ce deemed to preclude the defend- 
ants from seexing appropriate protective orders fron 

the Court with respect to the confidentiality of tests 


Or test questions or the i@encity of individuals. 


Duration 


Except as otherwise expressly provided hereia, these 
3 


reporting and monitoring provisions shall remain in 


effect until the expiration of two years after admin- 

istration of the last new examination for a supervisory 
position in existence or created by combining positions 
in existence at the date of the Court's Order confirn— 


4 
< 


ing this Plan, or 5 years after the announcement of the 


last prototypical examination, whichever is later. 


|| UNITED STATES DISTRICT COURT 
' FOR THE SOUTHERN DISTRICT OF NEW YORK 383a 


i} i BOSTON M. CHANCE, 
cena C. MERCADO, et al., 


Plaintiffs 
| ~against— : 70 Civ. A141 
\| i (H.R.T.) { 
THE BOARD OF EXAMINERS AND THE BOARD OF 
'| EDUCATION OF THE CITY OF NEW YORK, e& al., 
H AFFIDAVIT 

Defendants : 


STATE OF NEW JERSEY ) 
| COUNTY OF HUDSON ) 


| 

| 

! RICHARD S. BARRETT, being duly sworn, deposes and says: 

| 

1. lI am the Director of the Laboratory of Psychological Studies and of 
| . 


} 
| 
i 
| 
| 
| 
} the Applied Psychology Division of Stevens Institute of Technology, Hoboken, 


New Jersey. I hold a Ph.D. in Industriel Psychology and since 1951, have 
\ 
| specialized in research, teaching and consulting work in the fields of testing | 
tf 

|, and fair employment. I have previously submitted affidavits in the above— 


owe action and have testified or suomitted papers as an expert witness 
| 


I 


ie 
‘ing supervisory personnel in the New York City scnool system. 


ba many fair employment litigations. 
2, I submit this affidavit in support of the Plaintiffs’ Motion dated 


‘| 
i 
| 
January 3, 1975 for an order modifying the Final Judgment of July 2, 1973 
i 


(‘herein and approving a Plan for development of a new permanent system for select— 


‘| 
! 3. I have read paragraphs IX and X of the July 12, 1973 Final Judgment 
hin this case. I have also read a document entitled "Plan Proposed by the Board | 


of Examiners, Board of Education and the Chancellor, for Licensing Supervisors . 
| 
jin the New York City School System" (hereinsfter the "Plan'?) which I am advised | 


as submittea to the Court by the parties on May 24, 1973. 


i 4. Although the Plan, in the words of its first sentence, “outlines a 


| procedure for the development of" new supervisory examinations, it cannot be 


il 
i! deemed to constitute a detailed description of a new licensing system, ready for 


,, generate substantial data relevant to the validity, job-relatedness and compli- 


prior to impl 
5. Ee 


ementation. 
ve read the proposed "Reporting Requirements" included by the 


! implementation in accordance with paOh8.on x of the Final Judgment. At most, 
‘the Plan sets forth guidelines for the Boards of Education and Examiners and 

: their consultants in working out such ea system. Before an actual selection 

| system following such guidelines could te developed, intensive work would be 


i required to devise specific tests and evalus’ion procedures; this process would 


: ance with the Plan of the kind which plaintifis would be entitled to review 


i Board of Examiners as paragraph V of a Plan submitted with their Motion of 


| Decenber 20, 1974 and the "Reporting and Vonitoring Requirements" included in 


the Plan annexed to plaintiffs' January 3 Motion. In ry opinion, the in- 


formation required by the defendants’ "Resorting Requirements" would not afford 


plaintiffs either the "detailed description of the new selection system" or 


"all relevant data relating to the new selection system and its development" 


required by paragraph X of the Final Judgnent. Defendants propose only to 


provide "a description of the scope" of 45¢ Step 1 examinations before they 


are administered. 


ished regarding either the development of the tests or their actual character— 


This does not indicate that any information would be furn— 


istics. No information at all would be furnished permitting appraisal of the 


job-relatedness or fairness of the Steo 2 evaluation procedures, either before 


or after they were administered. 
In my opinion, plaintiffs' proposal in its "Reporting and Monitoring 


more than necessary +o assure that olainti: 


each test and relevant information bearing on tne degree to which developmental 


6. 


i ment of Step 1 tests and Step 2 evaluations for prototypical positions is no 


s have an adequate dsscription of 


procedures complied with the Plan and provisions of law. 


7. 


I have read a proposal by the American Institutes for Research ("AIR") ; 


ry 
b] 


4 


cS WO 


! 
dated August 8, 1974 and titled "Prototype Job Analyses for Taree Suvervisory 


| 


fork City School System." On the basis of this docu- 
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ment I was asked by plaintiffs to assess AIR's qualifications for performing 


| the job analyses specified in the Plan and the appropriateness of their choice 


for this assignment by the Board of Education. In my opinion, the proposal 
submitted affords insufficient basis upon which vo answer either of these 
questions. 

8. An appropriate proposal for the work of job analyses upon which an 
informed choice among apparently qualified firms could be mads, would include 
substantial detail not contained in tne AIR proposal. Among other things it 
would provide information on the identity and qualifications of personnel in 
the firm who would respectively supervise and implement the various tasks 
involved, the time which would be invested in particular tasks by personnel at 
different levels, the time to be devoted to oral interviews and consultations 
and the capth of such inguiries, the procedures for selecting personnel to 
be interviewed, and the manner in which results of each step in the analysis 
would be assembled and used. In addition, the proposal would specify pro- 
cedures and a time schedule for furnishing ongoing reports to the client on 
the progress ofthe task. The omission of these necessary data from the AIR 


proposal should, in my opinion, at least have deferred the firm's selection 


i 2 
Jee /\: ee 
ee a een 


Richard S. Barrett 


for the job analyses. 


STATE OF NEW JERSEY 
COUNTY OF HUDSON 


Sworn te oefore me this jo i 
day of December, 1974 


otagy Public 

JOSCCHIN: L, VITALS 
NOTARY FUSL'S cH Ste» gos 1 
My Commission Exoi-es Aorit |, ri? 


cs ca 2 Wo. oceania cham anl eapeacarG ene eta + + eet AAOY TEA S 


JEANNE R. SitvzR 

386a Attorney at Low : a 
20 WEST <Orm STPIET | 
NEW YORK. N. Y. 10018 


(212) 334.5130 


December 2, °197k, 


Leonard Berniiow, Esq. 

Corporation Counsel ane 
Municipal Building — Room 1643 . 
New York, New York 10007 i 


Re: Chance v. Board of Examiners — Permanent 
Licensing Systea 


Deer Len: 


It has come to the attention of plaintiffs that notirithstanding 
Our urgent request to the contrary (see my letter of November 18), the 
Board of Education passed Item No. 23 on its November 20 agenda, and 
euthorized its Secretary to retain Anemican Institutes for Research as 
‘consultant on the job analyses for the Permanent Licensing Plan. I an 
writing to reiterate my oral protest to you Over the telephone last wee 
and our request that the Secretary withhold any action in this matter 
pending further commmications by plaintiffs with the Board and the AIR 
‘firn. & : ‘ ‘ : pen : woe i i 

In my November 18 letter I rointed out that plaintiffs’ consent 
to the permanent licensing plan was conditioned on selection by the Board - 
of an acceptable consultant and thet, in eccordance with Ciscussions with 
you and your client, we had expected an adequate opportunity both.to in- 
quire into the credentials of three fircs Originally under consideration 
‘and to consult with the Board about our findings. Instead, after we were 
denied even the courtesy of a reply to our request for pertinent Gocunents, - 
the Board made an executive session selection of one firm. Only thereafter 
did sie receive the requested copy of that fira's‘proposal. fie Scarcely ‘hed 
tine to study it and comment before the Board's action in Public meeting to 
select the firm over our specific objection. 

Wie have continued our reszarches on AIR in the hope that despite 
the unfortunate circumstances of the firn's selection, our concerns about 
its probable performance might be diszelled. In fact continued investi- 
g2tions have strengthened our doubts. &IR's work on the nes Fire De 
ont cae fe 4 i c25 ; ? 


ase : ‘ as wed eet leo Et rh a ae os 
© Sxanines ons required by tie ¢ = 


in chich Bli 


s, cn Elisebets Dos 

is among plaintiffs' counsel, has b22n Very seriously questionad b, ploin-~ 
tiiis there. Particularly since the Board's Secretar; cited this assizn— 
meat as one basis for AIR's choice by thea Board of Education, this fector 


—s 8s 
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alone sugzests a reason to give further thought to the firm's compsvence 
before entering a contract with it for the crucial Stage of prototypical 
job analyses. 


Without endorsing any particular firm at this time, I think I 
may add that our researches tend to Suggest that one of the other firms 
On the Board's list might be preferable to AIR. Lacking opportunity to 
read proposals they may have submitted, we are not ina position to make 
cefinitive coments, but each of the others which was on the Board's list 
has received some favorable comments from experts we have consulted and 
each is believed free from some of the Possible potentialities for bias 
and liminations as to Scope of prior work which have been reported or 
indicated in connection with AIR. ae | 


In view of the foregoing, we feel it would be highly questionable, 
not only in terms of the Board's posture as defendant herein but also as 
a matter of public policy, for the Board to contract with ATR before . 
specifically considering our objections. Such consideration would be most 
fruitful if the AIR firm were itself involved and responsible personnel 
would answer our questions. 


I am accordingly making a formal request at this tims that in 
addition to delaying the apvointment of ATR, the Board arrange One or . 
more meetings, in which plaintiffs' counsel and experts could discuss 
AIR's proposal and qualifications with members of the Board and respon~ 
sible members of AIR. In addition, we would like to discuss the creden- 
tials and proposals of other firms which were considered by the Board with 
a view to seeing whether we can reach agreement on the acceptability of 
any one of them. In the latter connection, I again reiterate ny request 
for copies of the proposals submitted by Development Dimensions, Inc., 
Felix Lopez, Inc. and any other firms the Board has had under considere— 
tion for the prototypical job analyses. 


Sincerely yours, 


Elizabeth B. Dugois, Esq. 


| SSE ee 
Jeanne R. Silver 
Abtorneys for Piaintifis 


CC: Mr. Harold Siegel 


JEANNE R. SILVER 
Abtorne; ct Lew 
20 WEST <om™ STREET 


NEW YOAK, N.Y. 19019 


{212) 354-6190 


Hovenber 15, 


Mr. Harold Siegel 
Secretary — 

Tne Board of Education of the City of New York 
119 Livingston Street 
Brooklyn, New York 11201 


Res 


Chance v. Soard of Exominers 
Dear Harold: 


I have just received the Board of Education's agenda for its Noverber 
20 mesting and am shocked to discover that despite my repeated objections | 
in telephone conversations with you and Leonard Bernikow over the last to : 
weeks, the Board plans to go ahead with a unilateral decision to retain 
Americen Institutes for Research (AIR) to do prototype job analysss for the 

ereanent new licensing system. 

Last summer when the parties to this action submitted the proposed 
licensing system plan to the Court as a substantial agreed—unon document 
we made clear that plaintiffs' concurrence was conditioned uron resolution. 
of thre outstending matters. One was selection of a consulting fira 
acceptable to plaintifis to perform the prototype job analysas. To facili- 
tate determination of this issue, you furmishad us with the names of three 
firms under consideration, authorized us to contact thea; it was also indi— ~ 
cated that any new proposals would be made available tio us. : 

Although plaintifis made every effort to expadite the agreed-uron pro- 
cedure, the Board has not been cooperative. For example, in oc slip 

4 


i=) 
~ 
2 

- 


inguirics revealed that one or more of the firms, including AIR were about 
to sudonmit a So On August 16, I wrote -.the abbached lett ar re~ 
Questing én Qosortumity to examine rss documents when thay ware subaitted. 


I never received en answer to ry August 16 letter. & few wv 

allied tir. Bernitmow to inguire “ gbor ut this lack and to discuss th 

ntter under the circunstances. Ha said he wes eis se re 

3 eS mversation with Ais cliesas. Tf are la 

aAdned mea that the Board nad selected 4£7R and ¢ oils have the peas on its 
Qvember - 20 agenda. 


* 
e 


Wd cF§ Oo 


oe 
— 


BXHIGIT °-3 


Nov. 18, 197% 


Plaintiffs consider the Board's cou of action in this matter to be a 
serious breach of our understanding, i questions of good faita on its 
part. ore importantly, we are concerns ous the sudstsmiive choice of 
#1R. The proposal which you sent me on hdveaoer § does not dispel doudts 
which we had developed based on our 0:m research about this firn's qualifi- 
cations to perform the analyses. It is sossible that these doubts migni be 
set to rest if there were an opportunity for further inguiry end comparison 
batwaen AIR and other firms in the ligne of i heir proposals. How— 
ever, we cannot on the basis of presexs infor conclude that AIR is 
qu2lified either to address the substantive pro f rational job analyses 
for school supervisory positions or to rroceed wit! sensitivity to racizl, | 


~ 


athaic amd commmity issues required in ths cir ‘ Of tais case. 


I em accordingly writing to reiterete our stremuious objection to in— 
clusion of Item 23 on the Board's agensa for ednesday. It would certainly 
be unfortunate to jeopardize the agreecens on a permanent licensing systea 
for which we have all struggled so long. We pslieve it is unnecessary to do 
that,yet unless the Resolution is voted éown or leid over, plaintifis* con-. 
ditional consent to the Plan will have to be ceemed withdrawn. ‘ . 


Very truly yours, 
Elizaneth B. DuBois, Esq- 
‘ na 
aoe LANs O os. eo 
~ 
R. Silver, Esq. 


* JRS/ng 
. 


CC: Leonard Bernilow, Esq- 
Howard Jacobson, Esq. 
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JEANNE PR. SILVER 
Asioms; at Law 
ROWEST core STREET 


N=w YOAK, N Y. 190%a 


(212) 354.6190 


August 15, 1974 


Leonard Bernitnyw, Esa. 
Corporatica Counsel Office 
Municival Building 

New York, New York 10607 


Re: Cnance et al. v. Board cf? Exaciners, et 2 
Patil ndieadin i ea ? Ps aes 


Dear Len: 


In the last meeting between plaintiffs’ counsel and Board of Edu— 
cation representatives regarding the percanert licensing systen, Harold 
Siegel furnished us with the names of three consulting firms which the 
Board is considering for. erformance of prototypical job analyses pur— 
Suan to Part I of the dreft Permanent Licensing Plan. It-was esrese 
oar plaintiffs' representatives would cake inquiries to determize 

pathie exy Or all of these firms are acceptzole to us and that in thet 
pire Pom we could communicate directly with your contact persons at 
each firm. Recently, upon cOmmuniczting with one of the individuels 
you hai mentioned, we were advised thet his firm would be submitting 
2 proposal for conduct of the analyses et the end of that weak — 


Pl2intifis' counsel ware not aie that the fires Mr. Siegel nen 
tioned had bsen asked to subzit prozosals pending their possible selec— 
tion for tha job. It seens clear that ew. £ such proposals 
would facilitate our assessaent of ‘the consultents'’ qualifications,. 
possibly obviating long, exzensive trips to interview thea, end certainly 
hastening the end of our investigation. -* 


In view of the proposals' clear relevance for this uircose 
imzsins no sericus consider2tion which sould prevent you malding the: 
available to us and cur consultants in the matter on 2 confidentiel desis. 
Hesdless to say, our usa of them sould b s! ‘ 

t 


3 | 


eiwries wear nar tr a £tirns aYrTA acwraaa'sis 


Be a ate oy wnaetnar S25 Sas Cll 


EXHIBIT c-5 og 


Leonard Bernitouw, Esq. 


Accordingly, I 
by Devalopaant Dimansions, Inc. : 
Institutes for Research, or 
ing for the job analyses be : 
tney are received. This request sh 
of our rartual concern that work on the de 
plan begin as soon as possible. 


JIRS/azg 


Cc: 11 Z. Cohen, Esa. 
azabeth B. Duacis, Esq. 
-ofessor George Cooper 


~ 


ails 


New York University 3928 ‘ao | 


School of Education 
Center for Educational Research and Field Services 


51 Press Building 

Washington Square 

New York, N.Y. 10003 . i 
Telephone: (212) 593-2893, 3425 13 December, 1974 


Jeanne R. Silver 

Attorney at Law 

20 West 40 Street 

New York, New York 10013 


. Dear Ms. Silver: 


This letter is to confirm our discussion over the telephone yesterday regarding 
your request for information about our proposal submitted to the New York City 
Board of Examiners. 

I contacted the Board's attorney, Mr. Jacobson, end Mr. Murray Rockowitz, 
Board Chairman, as you suggested in your letter. Both requested that we not 
release to you our proposal to the Board. We will respect that request since it 
is the normal practice to treat proposals submitted to all our clients as 
confidential. 


As you would expect, we have no intention of challenging the Board's choice of 
eonsultant. Even if you were to determine after investigation of all consultants 
that New York University were superior, we could not accept such a contested 
award. It would be difficult to service properly an unwilling client. - - ° 


We respect your-concerns and your clients' needs. At this point, we do not see 
how we can make a positive contribution with any information that we could 
provide. 


I regret I carnot respond in 2 more positive way to your requests. Wishing 
you well, 


Sincerely, 


: : vote \ Leche 


EXHIBIT D ‘ James Richards 
Acting Assistant Dean 


Copy to Dean Daniel E. Griffiths 


” 
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Affidavit of Saul Z. Cohen, with 
exhibit, sworn to January 13, 1975 
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UNITED SLATES DISTRICT COURT 
SOUTHER DISTRICT GF UEW YORK 


- 
mo body 
eg Lie Sysga UN erage Si imend apatite es re taped eal ed end ee ath Ui tle uniee reali) acai ura X ee cove 
m5 ie se 
BOSTO!! HW. CHANCE, Et al... as es 
Plaintiffs, ce as 
-against- oe ee 
P70 gay 241) 
THE BOARD OF EXAMINERS and THE ae RY, 
BOARD OF EDUCATION OF THE CIT = Ee 
OF NE}! YORK, et al., : 
AFFIDAVIT 
Defendants. 
1 ee ee X 


STATE OF NEW YORK ) 
« SS.: 
COUNTY OF NEW YORK ) 


SAUL Z. COHEN, being duly sworn, deposes and says: 


1. I am an attorney and a member of the firm of 
Kaye, Scholer, Fierman, Hays & Handler, counsel for defen- 
dant Board of Examiners herein. I submit this affidavit 
in opposition to plaintiffs' motions with regard vO the 
Plan for the selection of supervisors within the New Yor” 
City School System, and in further support of defendants’ 
motion to modify the Final Judgment herein in order to 
permit the development and administration of examinations 
for supervisory positions in accordance with the Plan 
submitted by defendants. 

2. Plaintiffs' papers make clear that the 
parties are in agreement on a Plan for developing and 
administcring supervisory examinations which will satisfy 
the requirements of state and federal] law. Plaintiffs, 
however, ask this Court to give them a vo‘ce in the 


sclection of a consultant (called for by the Plan) which 


x . “ 
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; 
| was never arreed upon and not required. Further, plain- 

! tiffs ask this court, through proposed reporting vcroceduré:, 
to tive them a ¢ontinuing, ongoing, role in the develop- 
ment and administration of tests which, again, was neither: 
agreed upon nor reauired by any legal standard. Adootic=. 
of plaintiffs’ proposals would doom the Plan. The process 
of "negotiation" would be endless and the examination 
weeks ment of the New York State Constitution would be 


effectively abrogated. 


The Choice of Consultants 


m 


3. Not only did defendants never agree that tr. 
choice of consultants was to be by mutual agreement, the 
defendants expressly and categorically rejected any such 


concept and specifically insisted that the designation O° 


| 

| 

| 

| 

| 

| 

| a consultant remain the unilateral responsibility cf eacr. 

| Board (i.e., Board of Examiners with respect to validaticr, 

| ana the Board of Education with respect to job anélysis. 

| kh, It is precisely because of this firm, fixe: 

: and unyielding position by defendants that the Pian sub- 
mitted to this court on May 24, 1974 contains blanks wher: 

| the name of the consultant would appear. (See pr. 6 and 

| 292 of Plan as submitted May 24, 1974.) My recollection 

| on this point is crystal clear, viz.: The pisintilfs 

wanted consultants chosen by agreement. Defendants re- 

| jected this proposal. Plaintiffs next proposed aroitrat(-:.. 

| 4.@., the consultants would be selected by 4 panel with =: 
impartial third party to break a deadloc . Again, the 


| 
| proposal was categorically rejected by defendants. 
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Defendants insisted on the right to designate on their own. 
Mr. Monserrat, a member of the Board ef Education, spectrt- 
cally said the Boards could not and would not delefate this 
responsibility. He asked why plaintiffs were so sure they 
would object to consultants selected by defendants? Pro 
Cooper, a counsel for plaintiffs, opined that if defencéen 
picked known, reputable, consultants there would, in all 
likelihood, be no disagreement. Whereupon, it is my 
recollection that I suggested we submit the Plan with 
blanks. When defendants decided on a consultant, they outa 
inform plaintiffs' dounsels’ Maybe there would be no dis- 


agreement - in which case the parties need only F321) in. 
| 


the blanks. If plaintiffs disagreed, they were free to 

withdraw their endorsement of the Plan. That is precisely 

how it was left. 
It is now evident that although plaintiffs do 

not wish to withdraw their approval of the jointly proposes 

Plan, they wish to foist upon defendants the very procedure 

for selecting consultants which defendants expressly re- 

jected. : 
S. There iS no constitutional or other legal 

principle which gives plaintiffs the right to participate 

in the selection of a consultant called for by the Pian. 

Nor is there any such principie which would require this 

Court to substitute its judgment in this matter for that 

of the authorized governmental body. The use of a con- 


sultant was not mandated by any constitutional principle. 


Defendants could have decided to develop the examinations 
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themselves. Having agreed to utilize a consultant, ther 
reserved the right to make the choice. They do not interns 
to negotiate with plaintiffs concerning this matter and 
have refused efforts by plaintiffs to draw them inte suct 


negotiations. 


6. The record should reflect the fact that 


he «re 


Development Dimensions, dne., the consultant selected bd} 
Board of Examiners with regard to validation of the nev 
examinations is a highly respected agency which hes wide 
experience in such work.-. Its clients include numerous 
large private corporations as well as governmental agenci= 
Attached hereto as Exhibit A is an information sheet with 
regard to Development Dimensions, Inc. which describes 
that firm and wists some of 4ts other clients. 

7, Finally, this court should be aware of the 
difficulties which would ensue 4f defendants are forcec 7: 
develop and administer examinations using consultants whl? 
are not of their choosing. This point is made quite Giles” 
din Exhibit D to plaintiffs' own motion papers, a copy ‘oe 
a letter from Acting Assistant Dean James Richards of 
New York University Center for Educational Peceaoe anc 
Field Services ("N.Y.U.") to plaintiffs' counsel dated 
December 13, 1974. N.Y.U. was one of the agencies whic? 
submitted proposals to the Board of Examiners to act as 
consultant regarding validation of new examinations. [ne 


Board of Examiners rejected N.Y.U.'s proposal anc chose 


Development Dimensions, Inc. instead. 7 .2an Richard's 


n 
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letter clearly indicates that N.¥.U. would not even be 
willing to serve as a4 consultant now since it would nou nev: 
been willingly chosen by the Board of Examiners. Thus, the 
letter states: 

"As would expect, we have no intention 

of challenging the Board's choice of con- 

sultant. Even if you were to determine ! 

after investigation of all consultants that 

New York University were superior, we could 

not accept such a contested award. It would 


be difficult to service properly an unwill- 
ing client." 


| 
The Issue of Reporting Requirements. | 
| 
&, Plaintiffs! primary contention with regard to | 
the reporting requirements set forth in the Plan submittec 
by defendants is that those requirements are inconsistent 
with the terms of the Final Judgment herein entered July 
12, 1973. Plaintiffs urge that, although defendants have 
made their motion to permit new examinations pursuant to 
paragraph IX of the Final Judgment, defendants' proposed 
reporting requirements fail to comply with the requirements 
of paragraph X of the Judgment, under which derendants | 
should have moved. This contention is based upon an | 
erroneous reading of the Final Judgment and totally ro, 
the proceedings herein between the time the Stipulation of 
Settlement was initially submitted to the court in early 
April of 1973 and the Final Judgment was entered in July a 
1973. | 
| 
9. The Stipulation of Settlement herein was sub-. 
mitted to the court on or about April 2, 1973. It peau. 
for the inclusion in a subsequent final Judgment of langues? 


j 
essentially similar to that presently contained in paracrar? 
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X of the Final Judgment.* However, defendant Board of 


Education objected to the Stipulation and refused to exe- 
cute it because, among other things, there was no tire 
limit within which plenary examinations for supervisors 
would be substituted for the interim on-the-job evalua- 


tions which the Stipulation contemplated. 


10. The Board of Examiners then indicated that 
4t would be willing to insert a provision inte the Stipulée- 
tion putting a time limit on the interim evaluations and 
plaintiffs and the Board of Examiners agreed to alternative 
provisions. On May 21,1973, this court rendered a 
decision which approved the Stipulation, subject to a 
later hearing required by Rule 23 of the Federal Rules of 
Civil Procedure, sc long as it was amended to add a new 


provision reading: 


"Tl. Within six (6) months of the effective 
date of the judgment entered pursuant to 
Paragraph IV hereof, the parties shall either 
agree upon a plan for a permanent system for 
the selection of supervisors within the New 
York City School System, or any party shall be 
free to apply to the Court for modification 

of the judgment." 


cxaeceenceennnatattei ttt LCCC LC CTT 


*Paracraph II(I) of the Stipulation provides that the con- 
sent judgment to be entered thereafter must contain the 
followings provision: 


"TJ, Any party may, upon at least 3 weeks! written 
notice to counsel for all other parties, apply for 


as 


modification of the Judgment to permit the implementaticr 


of a new system for the selection of supervisors in the 


New York City School System, provided that a detailed c=- 


scription of the new selection system, together with al- 


relevant data relating to the new selection system ena 
4ts development, have first been made available to all 
other parties and an opportunity afforded to such other 


partics to review such data and to confer with the appli- 


cant with a view to resolving, any differences that may 
arise and reaching, agreement upon new cxamination pro- 
cedurcs that are to be the subject of such application. 
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This provision is now paragraph IX of the Judgment, pur- 
suant to which defendants have moved.) Moreover, since 

the Board of Examiners had insisted upon the right to seen 
modification of the judgment prior to six months after the 
entry of a judgment if it quickly became evident that no 
agreement could be reached on a pian for new examinations, 
the May 21, 1973 decision also required the addition oT a 
"ynrefatory phrase" to the former paragraph Tr (1) of the 
Stipulation (see above), providing that notwithstanding che 
new provision, a party could still apply for modification 


earlier, upon three weeks' notice. 


11. Thus, both paragraphs IX and X of the Fire: 
Judgment were intended to permit the modification of the 
Final Judgment so that plenary examinations could be admin- 
istered. The distinction between those paragraphs which 
plaintiffs seek to draw is unwarranted. Paragraph X was 
clearly intended to deal with a situation where there has 
not been an agreement between the parties on a detailed 
Plan for new examinations. Since such an agreement has beér 


reached here, paragraph X is clearly inapposite to defendér::’ 


motion to implement the agreed upon Plan. 


12. In any event, defendants' motion complies 
with paragraph X since the Plan itself contains "a detaile: 
description of the new selection system, together With ail 
relevant data relating to the new selection system and its 


development ..." Of course, plaintiffs helped to 


"describe" and "develop" the system. Plaintiffs participat¢: 


| 
i| Ola 
| in the entire process of negotiations, task force meetings 


and consultations with interested persons, including recve- 
sentatives of the 32 community school boards and various 
“Yoxnerts". And plaintiffs have approved the system. Thus, 
\ plaintiffs already have the description and relevant date 


‘ recuired by paragraph X of the Final Judgment.* 

13. Finally, it is quite clear from an exemins- 
|! tion of plaintiffs’ proposed "reporting and monitoring re- 
 guirements" (see pages 23-29 of Exhibit A to their motion 


| 

papers) that, in view of the minutia which plaintiffs wish *-: 
! receive and in view of the fact that the administration oy 

j 

! 


all prototype examinations and the promulgation of results 
for both prototype and nonprototype examinations shall be 
subject to plaintiffs' approval, the implementation of the 


Plan will become hopelessly bogged down first in negeotietic:= 


| 

! 

| 

| and, inevitably, in endless litigation. 

| 

| 

| 14, Plaintiffs seek to obtain actual protot; re 
| 


examinations or "adequate samplings of test and test cues- 
tions" (see VAlb (1) of plaintiffs' proposed Plan) in adver:: 


of the giving of those examinations and apparently wish tc 


- 


~ 2 


or their consultants during the development and administre- 


| 
| 
receive almost every piece of paper generated by defendéen 


et NCCC CL CT 


| * Paragraph X of the Final Judgment requires a descrictic: 

| and relevant data with regard to the "system", not with 

repiard to the specific examinations which are to be devel- 
oped cursuant to that system. What plaintiffs seek throur: 

‘their “reporting and monitoring, requirements" is the de- 
tailed minutia which will result from defendants' creaticr. 
and administration of actual examinations. 
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of examinations, the promulgation of results and validation 


of those examinations. Thus, for example, plaintiffs wish tc 


receive "on an ongoing basis all summaries, studies and 
reports generated in the course of conducting the job 
analyses" (see paragraph VAla(2) of plaintiffs' proposed 
Plan). In addition, plaintiffs wish the entire procedure tc 
be subject to their constant approval. Thus, for example, 
prototype examinations may not be administered “until after 
[defendants] hav[e] obtained agreement by the plaintiffs 
and/or approval by the Court" (see paragraph VAl1 of plain- 


tiffs' proposed Plan). 


15. Plaintiffs have built themselves into the 


educational process as partners with the governmental agencics 


which have been duly authorized by statute to operate the 


New York City School System and develop and administer exam-. 


{nations for supervisors in it. Plaintiffs' proposals would 
mean that the new examinations contemplated by the Plan will 


not be administered for many years. In the meantime, of 


| 
| 


| 
| 
| 


course, the "interim system" would continue.* This procedure 


*When the Court of Appeals for the Second Circuit upheld 
the settlement of this action in April 1974, Chance v. 
Board of Examiners, 496 F. 2d 820, 825 (1974), it noted: 


", . .Were the litigation to remain indefinitely in 
4ts unfinished state, the propriety of continuing to 
allow permanent appointments would be another matter. 
The interim tail would then be wagging the dog and the 
incentive for plaintiffs' class to obtain a permanent 
non-discriminatory testing system would diminish con- 
siderably and perhaps disappear. . . Allowing another 
lengthy period of time to fo by, thus creating, further 
eligibles for permanent appointment as an *interim' 
Measure, would approach an abuse of discretion." 
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zives defendants more than thev could have achieved “ac 77: 


won this case after litigation on the merits. 


16. We have previously noted the relationstic 
between plaintiffs’ present counsel and the Public =cuce 
tion Association. (See e.g., the affidavit of Murrey 
Reockowitz, sworn to December 16, 1974, which was subd=-: 
in opposition to plaintiffs' contempt-modification moticr 
paragraphs 14-15). The publicly-stated objective of the 
Public Education Association is to eliminate examinations 
for supervisory personnel in the New York City School 
System. Plaintiffs' proposed reporting requirements whier 


were drafted by counsel for Public Education Association, 


are an effective method of achieving that end. 


17. Certainly, plaintiff's are entitled to 


information, for a limited period of time*, with regar< 


what defendants have done in developing and administerinz 
actual examinations pursuant to the Plan. Defendants' ?P2 
includes a reportirg provision to achieve that objective. 
But neither the Final Judgment herein nor any principle 
of law should make plaintiffs' counsel a state educations 
agency. The New York Constitution and 


Law impose on the Board of Examiners the responsibility 


* Plaintiffs propose that their reporting requirerents 
continue for at least five years, and probably longer. 
Since there are numerous supervisory positions in the 

itew York City School System, for some of which examinat.--: 
are rarely administered, the “last new examination" may 7.27 
be administered for years. (See paragraph V(J) of their 
proposed Plan). Thus, plaintiffs wish to continue their 
role for a period which in all probability will be wel? 

in excess of five years. 
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- 


developin= and administering, examinations. The defendant 


Board of “xaminers has gone a long way in seeking to revise 


{ts procedures and programs to meet constitutional reauire 
ments. It cannot be put in a position where it can onlyr 
function with approval of plaintiffs or where its every 
action will be the subject of litigation. We cannot telte 


that this court wishes to become the arbitrary suverin- 


tendéent of the staff developing supervisory examinations. 


Saul Z. Cohen 
SWORN to before me this 


13th day of January,1975. 


; : 
/ vo. . 
co ge Aree aaa fos es 


Notary Publi 


, 
ek Ueuny 
muh teeth 39, Jorg 


EXHIBIT A - Information sheet with 
regard to Development 
Dimensions, Inc. 


(Printed at pp. 786a-787a) 


* 
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Affidavits of Leonard Bernikow (plus 
exhibit) and Harold Siegal, swo to 
January 14, 1975 
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NITED STATES DISTRICT COURT 
OUTHEPN DISTRICT OF NEW YORK 


;OSTON M. CHANCE, et al., 


Plaintiffs, 
70 Civ. 4141 


(H.R.T.) 


ee 


-against- 


AFFIDAVIT 


HE BOARD OF EXAMINERS and THE 
..OARD OF EDUCATION OF THE CITY 
OF NEW YORK, et al., 


Defendants. 


STATE OF NEW YORK ) | 
¢ SS.: i 

COUNTY OF NEW YORK ) | 
} 


LEONARD BERNIKOW, being duly sworn, deposes and 
says: 

1. I aman Assistant Corporation Counsel in the 
office of ADRIAN P. BURKE, Corporation Counsel, the attorney 
for the defendants Board of Fducation and Chancellor herein. 
I submit this affidavit in opposition to plaintiffs’ mot. un 
with regard to the plan for the selection of supervisors 
within the New York City School System, and the selection 
of consultants, and in further support of defendants' motion 
to modify the Final "udgment herein in order to permit the 
development and administration of examinations for super- 
visory positions in accordance with the Plan submitted by 


defendants. 


pd 


2. I have reviewed the affidavit of SAUL 2 
Cohen, the attorney for the cefendant poard of Examiners, 
sworn to toe 13th day of January, 1975, submitted on the 
above-nentioned motions, and I believe it adequately and 
sufficiently sets forth the position of the Board of 


Raucation and the Chanccllor. 
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3. In addition, we wish to point out that the 


Board of Education has selected the American Institutes 
for Research ("AIR") for the development of job analyses. 
AIR is a responsible and experienced agency. Attached 
hereto as Exhibit "A'' is a copy of the prototype job 
analyses prepared by AIR. The Exhibit also contains some 


, , i : ; 
background material concerning AIR which included its 


related experience. 


es f, Me LO 
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- ‘Leonard Bernikow 


Sworn to before me this 


14th day of January, 1975 
JULIUS KAPLAN 
Commissioner of Deeds 
City of New York 2:1750 
Certificate filed in Kings County 


Ma 4 Coninission Expires May 1, 1973 
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UNITED STATES DISTRICT COURT 
SOUTHERN DISTRICi OF NEW YORK 


BOSTON M. CHANCE, et al., 


Plaintiffs, 


; 70 Civ. 4141 
-ageinst- 10.5.7.) 


THE BOARD OF EXAMINERS and THE AFFIDAVIT 
BOARD OF EDUCATION OF THE CITY 
OF NEW YORK, et al., 


Defendants. 


COUNTY OF NEW YORK ) 

HAROLD SIEGEL, beir duly sworn, deposes and says: 

1. I am the Secretary of the Board of Mducation of the 
City of New York and I submit this affidavit in support of the 


defendants' motion. 
2. Ihave read the affidavit of Saul Z. Cohen, sworn 


to the 13th day of January 1975. I have read paragraphs 3 and 

4 of Mr. Cohen's affidavit. Insofar as those paragraphs 
referred to ‘he position of the Board of Education and described 
what happened, they are accurate. I was present at the meetings 
when these matters were discussed. When the parties were dis- 
cussing the proposed order there were several matters that the 
representatives of the Board of Education, Mr. Monserrat and 
myself, felt had to be discussed with the fuli Board. The 
matter of the consultant for the job analyses was one of these. 
Subsequently the position ot the Board was clearly explained 

to the ceunsel for the plaintitfs. The Board wo *«< not share 


_the decision makinc process but would 


¥ 


as 


plaintiffs to react to the consultant and the proposal. This 
was done. 409a 7 

3. About the middle of August 1974 subsequent to a 
meeting of the parties, Mrs. Renee Roberts, then Counsel to the 
Board of Education, provided plaintiffs’ counsel with the names 
of the consultant firms under consideration. 

e.) Te. Roberts left the Board of Education and 
subsequently on or about November 1, 1974, I was asked by the 
President of the Board of Education to follow up on this matter. 
I tien checked to determine whether the three proposals of the 
consultant firms were still operative. On or about 
November 8, 1974 I was advised that American Institutes for 
Research ("AIR") was the consultant recommended by Mr.Monserrat, 
acting as a sub-committee of the Board. 

5. On the same day I immediately called Mrs. Frankl, 
counsel for the plaintiffs, to advise her that a resolution 
would be Sutsadanue for the next hantnees meeting of the Board 
of Education, at which time the Board would consider the approval 
of this consultant firm. I suggested to her that if she had any 
comment with respect either to the firm or to the proposal which 
was being sent to her, the Board would be *nterested in hearing 
this. 

6. The next I heard from Mrs. Frankl was her letter 
dated November 20, 1974 which is attached to the plaintiffs' 
motion parers. 

7. Although Mrs. Frankl did not appear at the public 


meeting, Mr. David Seeley, Director of the Public Education 


* oy 


a 
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Association, with which Mrs. Frank]. is associated, did appear 
to address t’ 2 Board. We are not clear whether he was acti.ug as 
surrogate for Mrs. Frankl. The main thrust of his statement 
was that there had not beer vhat he called "adequate 


consultation." - 


jf Haereld glegel 


Sworn to before me this 


14th day of January, 1975 


JULIUS KAPLAN 
Commissioner of Deeds 
City of New York 2-1750 
Certificate filed in Kings County 
Commission Expires May 1, 1975 


AMERICAN INSTITUTES FOR RESEARCH 
WASHINGTON OFFICES 


os 


3301 New Mexico Avenue, N.W., Was .on, D. C. 20016 
Telephone: (202) 686-65. 


P-3977-1-21 


PROTOTYPE JOB ANALYSES OF THREE SUPERVISORY POSITIONS 
WITHIN THE 
NEW YORK CITY SCHOOL SYSTEM 


In response to letter dated: 
July 12, 1974 


“4 


Submitted to: 

Board of Education of the 
City of New York 

110 Livingston Street 

Brooklyn, New York 11201 


Attn: Harold Siegel, Secretary Submitted by: 


Gary 8. Brumback, PhO. 
Senior Research Scientist 


8 August 1974 
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ADMINISTRATIVE INFORMATION 


The American Institutes for Research is a nonprofit, scientific 
and educational organization incorporated under the laws of the 
Commonwealth of Pennsylvania in 1946. The status (not a private 
foundation) of AIR is described in Section 509 (a) (2) of the Internal 
Revenue Code and has been officially recognized as such in a letter 
from IRS dated 13 December 1972. 


The primary person to contact with regard to this proposal and 
its staffing: 


Gary B. Brumback, Ph.D. 

Senior Research Scientist 

Human Resources Research Group 
American Institutes for Research 
3301 New Mexico Avenue, N.W. 
Washington, D.C. 20016 


Telephone: (202) 686-6800 


Matters of contract negotiations such as standard accounting 
procedures, audits, company policies and benefits, indirect cost 
composition and rate, payment schedules, fee, and contract award 
notification and contract documents for Signature should be communi- 
cated directly to: 


David H. Spiegler, Director 
Management Systems Office 
American Institutes for Research 
3301 New Mexico Avenue, N.W. 
Washington, D.C. 20016 


Telephone: (202) 686-6880 


Respectfully submitted, 
AMERICAN INSTITUTES FOR RESEARCH 
in the Behavioral Sciences 


David H. Spiegier 
Assistant Secretary/Treasurer 
Washington Office 
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INTRODUCTION 


This proposal presents the technical approach that would be used, 
the time schedule that yiould be followed, and the professional staff 
that would be drawn upon by the American Institutes for Research (A.1.R.) 
in order to (1) analyze three supervisory positions within the New York 
City School System in such a way as to constitute prototypes for future .- 
analyses of other positions, (2) review existing job titles for the 
appropriateness of combining titles and/or creating new titles, and 
(3) recommend a selection and training program for job analysts. 

As an immediate result of the work proposed here, the Board of 
Examiners would have the job analysis data that are necessary and suffi- 
cient for the development of job-related examinations for licensing 
supervisors jn each of three titles; Principal of an Elementary School, 
Assistant Principal (Elementary, Intermediate, Junior High School), 
and Assistant Principal-Supervisor of a High School Department. The 
praposed work would also provide the Board of Education with the required 
and continuing capability of having other positions within the school 
system subsequently analyzed according to model job analysis procedures 
and by properly selected and trained analysts so that job-related 
examinations can be developed for those other positions. 


BACKGROUND 


We are witnessing an end to the time when an examination could be 
constructed with only a casually acquired, sketchy understanding of 4 
job's qualification requirements. Job analysis is becoming an increasingly 
crucial factor in the development and later defense of examinations. 

We interpret the recent draft of the Uniform Guidelines on Employee 
Selection Procedures of the Equal Employment Opportunity Coordinating 
Council] to mean that unless a procedure, such as a licensing examination, 
can be demonstrated to be job-related and valid, jt is much more likely 
to be viewed as an unlawful instrument, it may not ensure that licensure 
depends only on "merit and fitness"; and, it will not be in conformance 


with the Standards set forth in these guidelines. 
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The concept of job-relatedness is an emerging one. According to 
the EEOC, a test, or examination, is job-related 
if it samples knowledges, abilities, skills, or other 
characteristics shown through a careful job analysis 


to be necgssary or important for successful performance 
of a job. : 


The EEOC does not view job-relatedness and validity as equivalent. This 
same view has been expounded by Robert Guion in his 1973 presidential 
address to the Division of Industrial and Organizational ‘Psychology 

and in a subsequent journal article.” He points out, for example, 

that a test can have criterion-related validity and not be job rele- 
vant if the criterion measure is not a valid index of overall job 
performance. 

Although examination development and validation are the responsi- 
bilities of the Board of Examiners, whereas this proposal is in response 
to an invitation from the Board of Education which is responsible for 
job analyses, the three functions are obviously interdependent and all 
the more so given the dual need for both a job-related and valid exami - 
nation. It follows, therefore, that one of the factors to consider in 
proposing a model job analysis system is its utility for all three of 
the functions. Other factors being equal, a job analysis system which 
both identifies critical job performance requirements and is a fecund 
source of ideas and materials for examination content and criterion 
measures would have the greatest overall utility. 


APPROACH 


We have concluded fron our assessment of the state-of-the-art in 
job analysis methodology, and from our own research and consulting 
experiences, that it is inadvisable to rely upon a single method pur- 
suant to the development of a job-related and valid examination. We 
recently completed the first year of a three-year project to develop a 
written test dévelopment and validation model for the Department of 
Personnel of the City of New York. Three occupational titles in the 
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competitive civil service system were chosen as research vehicles for 
the project, and five job analysis methods were tried and evaluated 
according to 13 evaluation factors. We found that no one method either 
excelled on all 13 factors or was inferior in all of them. Furthermore, 
we concluded that a single method should not be expected to be either 
robust or precise enough to justify its sole use if a legal challenge 

is anticipated. 

We are consequently proposing here an approach which combines three 
methods into an integrated multimethod job analysis prototype and which 
is designed to serve well the needs of both the Board of Education and 
the Board of Examiners. The three methods are the well known critica} 
incident technique, the job inventory questionnaire, and on-site obser- 
vations. As we shall discuss below, the third method constitutes a 
modification of the work sampling procedures of obtaining incumbent a 
and observer logs that are proposed by the two Boards and the Chancellor 
in their plan for licensing school supervisors. While our multimethod 
approach is at variance with that plan, we note that it would allow for 
the contractor to develop and prepare the procedures as outlined in the 
plan “and/or such other procedures as the firm deems appropriate." 

The critical incident technique is essentially a systematic way 
of collecting either direct or vecalled observations of effective 
and ineffective incidents of job performance.° As a job analysis 
technique, it determines the critical requirements of the job. It can 
also provide, based on the critical incident data collected, explicit 
rationales for test development, realistic and job relevant problem 
materials for examination components, and behaviorally descriptive 
standards for criterion performance rating sae” 8, 9 There is 
considerable flexibility in how critical incidents are collected, but 
for the approach proposed here, small group interviews would be the 
primary mechanism to de supplemented by mail-out questionnaire, if 


necessary. 

The job inventory is a standardized and self-administered checklist 
questionnaire. The checklist contains task descriptions, and respon- 
dents (usually incumbents) rate then on one or more dimensions such as 
relative amount of time spent on the tasks, their relative importance 


to the accomplishment of job objectives, etc. The U.S. Air Force 
pioneered this method after concluding that interviews, observation- 
interviews, technical conferences and open-ended questionnaires had 

too many shortcomings. '° The Air Force has refined the technique 
through numerous research studies, and it has had numerous applications 
elsewhere. !!» Ve 

The third method proposed here, on-site observations, would 
not require incumbents to maintain diaries, but observers would record 
their observations of on-the-job behavior onto a behavioral checklist 
derived from the critical incident data that would ‘ve been collected 
earlier. Further, the number of on-site observations would be minimal, 
no more than necessary to assure face validity and double check 
uncertain findings, if any, from the two other methods. 

We have not adopted the plan's work sampling methodology, per se, 
because we think the approach prepared here is more technically satis- 
factory, more economical and productive, and more ideally suited as a 
prototype system. The large number of incumbents and visits which would 
be required to ensure a representative sample of observable behaviors 
makes work sampling time consuming and disruptive. As a prototype, it 
would require for future analysis a cadre of persons trained in sampling, 
observational and recording skills. Moreover, it is not the most 
satisfactory way to determine what job knowledge and judgmental skills 
are required for successful performance. While the amount of time spent 
on each observed task could certainly be recorded by observers, they 
would be unable to “indicate the relative importance of the described 
behavior in terms of effective performance ."'® Also, sufficiently 
accurate estimates of the relative amount of time spent on different 
tasks can be obtained more economically by the job inventory questionnaire 
technique. '4 Finally, the plan's methodology has much less overall 
functional utility. 

We have organized our approach into 12 project tasks. Most are 
interdependent and have been sequenced so that the output froin a pre- 
ceding task flows as input into the following task. The tasks are pre- 
sented below and specify how the proposed methods described above would 
be implemented, as well as how th2 other project objectives yould be 


accomplished. 
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Task 1. ‘Orientation and First Work Session 

An initial meeting following go-ahead would be held between A.1.R. 
project personnel and Board of Education representatives to review the 
overall approach and its implementation, provide A.I.R. with an overview 
of the school system, structure, function and distribution of supervisory 
positions, and to establish channels of communication and points of 
coordination. Immediately after this introductory meeting, a more 
intensive, small group work session should be held to develop a pre- 
liminary list of major functions carried out by each of the three posi- 
tions and to discuss any project-relevant informational materials available 
to A.I.R. for subsequent review. 


Task 2. Collection of Critical Incident Data 

Critical incident data would be gathered by a group administered 
questionnaire. Individuals who are very familiar with supervisory 
responsibilities and performance, such as supervisors, incumbents, 
faculty and staff specialistss would be covered in a series of groups. 
The exact number of groups, their composition or size cannot be pre- 
determined here, but the total number of school personnel involved 
need not be large.” This is because the functional representativeness 
and not the sheer volume of critical incidents is the determining factor. 
Moreover, if the first one or two groups is highly resourceful, there 
may be no need for additional groups. . 

An A.1.R. project member would preside over the groups and make 
introductory remarks, distribute questionnaire, give instructions and 
answer any questions. The instructions would emphasize the need for 
functional representativeness of the critical incidents and would be 
accompanied by a list of the major functional areas identified in the 
previous project task. Group members would then individually complete 
and return their questionnaires by the end of the meetings. 

To complete the questionnaire, the individual would describe as 
many critical incidents as could be recalled per function. Four 


questions would be asked about each incident: 


| 
| 
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Which of the positions and functions were involved? 
What were the circumstances leading up to the incident? 
What was the consequence? 


What job knowledge, skills, personal qualities or lack 
thereof appeared to be responsible for the incident? 


0 
0 
i) 
Q 


Task 3. Construction and Review of Job Inventories 

The critical incident data, existing job specifications and any 
other related informational materials would be reviewed in order to 
construct a preliminary checklist of tasks for each of the three 
positions. The preliminary checklists would then be reviewed by a small 
number of job experts for accuracy id completeness. Revised checklists 
would then be put into job inventory questionnaires. Each inventory 
would comprise a task checklist, scales for rating both the relative 
amount of time spent on each performed task and its relative importance, 
and a section for identifying job knowledges required to perform the 
tasks. 
Task 4. Administration of Job Inventories 

A job inventory questionnaire would be mailed to approximately aT) 
incumbents in each of the three positions. It would be neither necessary 
nor really appropriate for supervisors to review or complete job in- 
ventories, since incumbents should be regarded as the authoritative source 
of job inventory data. This is because supervisors do not have suffi- 
ciently precise knowledge of differences among tasks in time spent or in 
other dimensions; moreover, incumbents do not tend to exaggerate their 


jobs when completing an inventory questionnaire. 


Task 5. Analysis of Critical Incident and Job Inventory Date 

The data would be analyzed within and across each of the three 
positions to determine the unique and common critical requirements or 
elements. An analysis of the critical incidents would identify the 
employee characteristics (task behaviors, knowledges, skills, abilities 
and personal qualities) required for effective or successful performance. 
The checklist data from the inventory would be analyzed to determine 
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the criticality of each task. '® 


mentioned by incumbents, especially for the critical tasks would be 
studied. 


The job- knowledge requirements 


Task 6. Construction and Use of Observation Checklist 

A checklist for recording observations of critical task behaviors 
would be constructed based-on the data from project tasks 5-6. A small 
number of on-site observations of incumbents at work would be conducted 
by A.I.R. project personnel in tandem with appropriate school personnel. 
There would be a pair of observers making independent observations of each 
incumbent observed. The observations would be recorded on the observation 
checklist. The number and duration of observations would be governed by 
several considerations, one. of which, mentioned above, would be whether the 
need exists to double check any uncertainties about the findings from 


project task 5 (the Board may have other considerations to suggest). 


Task 7. Special Interviews 
The Chancellor, Communi ty Superintendent, Community School Boards 


and/or Parent Associations would be interviewed by A.I.R. project per- 
sonnel to ascertain their perceptions of the three positions. Inter- 
viewers would not be apprised of our accumulated results, since their 
own, independent opinions are to be consulted. 


Task 8. Review of Pertinent Research Literature 

Given a careful, thorough job analysis for a specific, possibly 
unique school system, there is limited need for a review of the per- 
tinent job analysis literature, and the main value of reviewing the 
selection research literature is in discovering negative findings 
definitely not worth repeating. 


Task 9. Synthesis of Results 

The results from project tasks 5-8 would be synthesized into a 
final set of three job analyses and a documentation of the common job 
elements identified. The synthesis would include an integration of the | 
critical tasks from the inventory data with the critical task behaviors 
from the critical incident and observation checklist data. Each job 


a! alysis would provide the necessary and sufficient information to 
gi.ide the subsequent preparation of job-related and valid examinations 
oi detailed job descriptions. 


Task 10. Review of Results 

The job analyses and documentation from project task 9 would 
be submitted to the Board of Education for the reviews designated in 
its plan (pages 4-5). 


Task 11. Review of Existing Job Titles 

A.I.R. would review existing job titles and make recommendations 
where needed for the combination of titles and/or the creation of new 
titles. 


Task 12. Job Analyst Program Recommendations 
One of the numerous advantages of the critical incident technique 


and the job inventory questionnaire technique is that they require less 
training than some of the other job analysis methods we have studied. 

To be sure, some training is necessary and some persons would make better 
analysts than others. We would, therefore, make recommendations as 

to the specific content and methods of training and the qualities of 
individuals to be trained which we believe to be necessary to ensure 

an effective, ongoing job analysis program for the school syste 


Project Deliverables 
Deliverables would consist of the following: three job analyses 


and documentation of conmon elements, recommendations regarding titles, 
recommendations regarding job analyst program, all booklets and inven- 
tories, all observation and interview records, 2 all intermediate deta 
analyses. 
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11. 


lz. 


13, 
14. 
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& Taylor, W.H., Jr. Validity of estimates by clerical personnel of 


job time proportions. Journal of Applied Psyciiology, 1969, 53, 164-166.) 


18. 


16. 


i7. 


18. 


19. 


AMERICAN INSTITUTES FOR RESEARCH 


Group composicvion should be representative cf the relevant strata 
of schools such as size and socioeconomic level. 


Mail-out questionnaires could be used in lieu of additional group 
meetings if the latter are needed but cannot be arranged. 


See, e.g., Madden, J.M., Hazel, J.1. & Christal, §.€. Worker 
and supervisor agreement concerning the worker's job description. 


Personnel Research Laboratory, Aerospace Medical Division, Air 
Force Systems Command, 1964. 


We define a critical task in this context as one which is Significant 


on all three dimensions: frequency of occurrence (number of times a 
task is checked); relative amount of time spent; and, relative 
importance to job objectives. More routine, less critical tasks are 
less significant on one or more of these dimensions. 


a 


The Board of Examiners should find the critical incident data most 
useful in examination development and validation stages. 


tie, 
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PROJECT STAFFING AND TIME SCHEDULE 


The project manager for the A.I.R. effort would be Dr. Gary B. 
Brumback, who is a Senior Research Scientist in the Human Resources 
Research Group (HRRG) located in the Washington Office of A.I.R. As 
project managt > he.would be primarily responsible for.the planning of 
project activities as well as the day-to-day supervision of project 
efforts. He would also participate in the actual conduct of several of 
the tasks. 

For a three-month target date, the staffing would include, in addition 
to Dr. Brumback, ine following A.I.R. professional personnel in the HRRG; 
Dr. Dorothy S. Edwards, Principal Research Scientist, Ms. Tania Romashko, 
Associate Research Scientist, Mrs. Jean R. McNelis, Associate Research 
Scientist, and a research assistant to be designated. For a six-month 
target date, the above staffing would remain the same with the exception 
of Dr. Edwards. For either target date, Mr. Clifford P. Hahn, Director 
of HRRG, would serve as a senior advisor to the project. 

The time schedules for*the three and six-month efforts are shown 


in Figure 1. 
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FIGURE 1 
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RELATED EXPERIENCE 3 


‘Since its establishment in 1946, A.I.R. has completed approximately 
one thousand research and development projects fur a wide variety of 
civilian and military governmental agencies, private industrial and 
commercial organizations and foundations. Many of these have involved 
work of relevance to the work proposed here. 


A.I.R. is currently conducting several projects for the New York 
City Department of Personnel. These projects are directly concerned with 
the development and validation of selection procedures in accordance with 
the EEOC Guideiices. One project is concerned with establishing a proto- 
type system of juv anilysi's, test development and validation fer preparing 
written tests that 2*e used for initial selection and promotional purposes, 
and for preparing procedures for evaluating records of training and 
experience as a selection device. Another project is focused on proto- 
type procedures for analyzing the physical demands cf jobs and developing 
job related physical ability tests which will predict successful job | 
performance. A third project is concerned with the development of a 
specific, conten: valid written test. These projects, planned by | 
Dr. Edwin A. Fleishman, Senior Vice President and Director of the Washington | 
Office of A.i.k., and Mr. Hahn, are being conducted under their general | 
supervision. Dr. Brumback is currently primarily responsible for these 
projects. He is supported by Ms. Romashko for both job analyses and 
physical test development, and Dr. Edwards and Mrs. McNelis fer written 
test development. a 


Mr. Hahn is currently managing a project to develop and validate 
selection p.ocedures for factory maintenance men of the Brown § Williamson 
Tobacco Corpeation. This project is following the Guidelines in the job 
analysis/test development/validation process. 


A.I.R. also recently completed the development of Certification 
Examinations for therapy’ aides for the New York State Department of Mental 
Hygiene These job related examinations, concerned with numerical 
operations, communication skills and mental health and behavior, have been 
used to <ertify employees and allow them to enter a new career ladder. 

Means for the various test scores for Whites, Blacks, and Spanish-speaking 
er ops were very similar, although the variance of the minority groups was 
somewhat greater than for the Whites. This effort was under the co-direction 
of Dr. Edwards and Mr. Hahn, with support from Mrs. McNelis. 


A.I.R. is also conducting a project for the Air Force to develop per- 
formance criteria at the job task level. This project involves aircrast 
mechanics, ground radio communication equipment repairmen, and communication 
center cperators. It involves selecting from the 200-400 job tasks identified 
by current Air Force job analysis ~rorcodures those forty to fifty critical 
tasks which best discriminate betwe’r good and poor performers. Each of 
these tasks' dimensions of task per‘ormance such as quality, speed, self- 
initiation, thoroughness, etc., were examined and self, supervisor and peer 
rating procedures vere developed to rave job incumbent perforinunce on the 

-eritical job task dimensions. Mr. fein is primarily respuasible for this 
project. 


A.I.R. is currently collaborating with two other firms in a 
national survey of manpower needs in the law enforcement and criminal 
justice fields. A.I.R. is responsible for identifying and analyzing 


a. key occupations within those fields. Mr. Hahn, Dr. Edwards and 
Dr. Brumback are contributing to that effort. 


Some additional projects, a number of which involved re-sonnel 
from the Washington Office who would be available for cor. \tation o- 
work on this project, are abstracted below. These projects are illus- 
trative of A.I.R.'s substantial experience in the areas of job analysis, 
test development and validation, job analysis training. and job per- 
formance criteria. 


Critical Requirements for Effective Performance as a Research Administrator 

This planning study, to define the critical require -nts for effective 
research administrator performance, was accomplished by reviewing pessuiel 
and literature and by disucssing the topic with administrators of research 
and academic people who have been actively involved in research or research 
management and related areas. E-9. CARNEGIE CORPORATION 


Critical Requirements for Research Personnel 


Critical incident data were systematically c-llected from a sample of 
experienced research workers in scientific and engineering grap:, in 
order to determine the critical requirements for successful parc? ivation 
in research and engineering work. This study was pazt of a piapneheneies 
research program concerning the selecton and evaluation of research 
personne]. A-5. U.S. DEPARTMENT OF THE NAVY, OFFICE OF NAVAL RESUARCH, 
HUMAN RESOURCES DIVISION, MANPOWER BRANCH. 


Critical Performance Requirements for Orthopedic Surgery 


Derivation of a an explicit and comprehensive behavioral definition 
of "competence in orthopedic surgery from critical incident data." The 
definition was expected to have potential application as a criterion of 
competence which the American Board of Orthopedic Surgery could use in 
evaluating and possibly revising their examinations for certificacion. 
Critical incidents -- factual reports of situations in which colleagues 
had been observed to perform either competently or incompetently - were 
classified into nine: major areas of comnetence, 28 sub-categories, and 
94 behavioral sub-areas. E-6. UNIVERSITY OF ILL1)01S, OFFICE OF RESEARCH 
IN MEDICAL EDUCATION. 


Critical requirements for Pharmaceutical Representatives 


Critical incident data were collected to establish critical require- 
ments for sales representatives of a large sundance company as a 
first step toward specific improvements in company procedures for selection, 
training, and proficiency evaluation. Requirements were analyzed in “hese 
areas: mastering technical information and procedures; showing sales 

acumen and finesse; meeting responsibilities conscientivusly; developing 
effective personal relationships. B-52. CIBA PH! RMACEUTICAL PROD! TS 
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Critical Aircrew Job Requirements and Aircrew Job Element Aptitude Tests 


A broad program of research concerned with an analysis of aircrew 
specialties and the classification of aircrew personnel was conducted in 
three major phases: development of a job analysis procedure based on the 
critical incident technique; identification of aircrew job elements in- 
volving ability factors and non-ability factors ‘such as attitudes and 
temperament; further refinement and definition of the aircrew job elements 
and construction of paper-and-pencil aptitude tests to measure the various 
job element aptitudes. U.S. DEPARTMENT OF THE AIR FORCE, SCHOOL OF 
AVIATION MEDICINE AND HUMAN RESOURCES RESEARCH CENTER 


Analysis of Helicopter Pilot Performance 


Identification of critical component abilities involved in piloting 
helicopters; development of refined methods for measuring these components; 
development of using performance measures singly and in combination; 
and a study of factors related to decrement and recommendations for the 
reduction of this decrement. HQ., U.S. ARMY MEDICAL R&D COMMAND, 

OFFICE OF THE SURGEON GENERAL. 


Human Performance Requirements for the CX-HLS:Aircraft 


Analysis of critical maintenance activities and ground operations for 
the “X-HTS (Nouglas C-Sa) aircraft including analysis of task steps, time 
required foi }erformance of tasks, requisite knowledges, skills and abilities, 
and other factors in the system. E-44. PLANNING RESEARCH CORPORATION. 


‘Personnel Requirements for the High Capacity Communications (HICAPCOM) Systen 


An early determination was made of personnel, training, and selection 
requirements for a personnel subsystem within the HICAPCOM System. Recommend- 
ations, based on job task analysis, were essentially a "best fit'' between 
personnel requirements of the equipment still under development and existing 
selection critefia, job structures, and training content. In phase II, 
maintenance training requirements for single sideband radio equipment were 
predicted. A computational rrocedure was developed for forecasting phase 
training input requirements to meet anticipated maintenance demands, 
qualitative training requirements for the newly developed type of radio 
equipment were prepared. C-44. U.S. DEPARTMENT OF THE NAVY, BUREAU OF NAVAL 
PERSONNEL, PERSONN=2L RESEARCH DIVISION. 


Special Education Requirements of Detroit Edison Jobs: Preliminary Study 


First of a planned three-phase program to develop generalizable pro- 
cedures for determining "specialized" (i.e., formal, other than on-the-job) 
education requirements for Detroit Edison jobs. A sample of four jobs was 
analyzed and described: Primary Meter Tester, Secondary Meter Tester, 
Field Meter Tester and Investigator, and Field Meter Tester. Skills and 
knowledge requirements were derived for all tasks within these jobs to 
ascertain which could best be filled by: (a) job entrance requirements 
for new hires, (b) on-the-job training, (c) specialized education. H-14. 
DETROIT EDISON COMPANY 
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Predicting new Air Force Position Qualifications —— 


A survey of the literature on prediction of Air Force personnel ae 
requirements, to provide background for the establishment of standard 
techniques and procedures. Methods of describing or analyzing positions 
or tasks, determining skill level for positions for which the associated 
equipment is not yet developed, combining work units and tasks into 
positions, and estimating the number of people required in a system were 
the areas examined. C-1. U.S. DEPARTMENT OF THE AIR FORCE 


Development of a Clerical Skills Inventory \ 


Analyze bank clerical positions in terms of core skill requirements, 
establish skills vocabulary, design inventory as a base for improving 
need assessment techniques, training programs and career development 
activities. This is the first-month funds authorized of a six month 
Overall study estimated at $35,000. 29200. THE CHASE MANHATTAN BANK 


Research on Methods for Determining Task Strategies 


Study to develop techniques that can be applied in increasing the 
substantive specifications of training requirements in terms of task 
content--to devise systematic methods for extending task analysis to 
incluce performance strategies. U.S. AIR FORCE. 


Field Survey to Evaluate an Experimental Set of Officer Duty Modules 


e 
This is the second of three projected contracts concerned with the 
design and evaluation of an experimental set of officer "duty modules." 
. Contract Number Two calls for task inventory surveys of officer in- 
cumbents which will establish whether the "job content"’ modules identi- 
ficd during Contract Number One are also ''duty assignment" modules. 
DEPARTMENT OF THE ARMY. 


Feasibility of the Questionnaire Approach to Job Evaluation 


Exploratory work using a relatively new approach to job evaluation. 
This study was conducted to determine the feasibility of systematically 
evaluating Air Force Officer positions by means of a job evaluation 
questionnaire composed of objectively stated, multiple-alternative 
items. A 300-item Job Evaluation Questionnaire (with items sufficiently 
subtle, objective, and comprehensive to serve as effective predictors 
and discriminators of grade and/or pay) was constructed and administered 
im @ mailed jucstionasire forma: to & semple of Air force Officers 
ranging in grade from Lieutenant through Colonel and covering positions 
an 235 different career utilization fields. U.S. DEPARTMENT OF THE 
AIR FORCE. ‘a 


Performance Standards for Key AID Jobs 


Research to identify sets of job standards for key positions in 
everse1s foreinn assistance missions snd to dsvelop and test an econcrical 
method for reviewinz job standards overseas whenever program requirements 
change. AGENCY FOR INTERNATIONAL DEVELOPMENT. 
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Review of Examining Program of New York State Department of 
Civil Service 


Objectives of the study included a general overview of testing 
problems and practices; review of similarities and differences in pre- 
requisites and evaluative methods for groups of positions at different 
levels and in major occupational categories; anc interpretation and 
utilization of evaluative data in personne! selection and placement. 

The study also investigated the feasibilizy of fuller utilization of 
computer technology in development, administration, and scoring of tests 
and in assignment of personnel. NEW YORK STATE DEPARTMENT OF CIVIL 
SERVICE. 


Development of Certification Examinations for Therapy Aide Positions 


in New York Department of Nental Hygiene + 


This projects called for development of qualification tests for 
a new career field in the medical areay The tests are to be used by 
the State of New York in their program of improving health care services. 
Three forms of tests in three areas were developed--communication skills, 
numerical skills, and patient care knowledge. NEW YORK DEPARTMENT OF 
MENTAL HYGIENE 


Scores Selection and Placement Battery 


. Deveiopment and validation of a classification battery designed 
for selection and placement of higher level personnel. Battery consists 
of 19 aptitude and 3 interest ‘tests which provide 38 separate scores 
forming six composite scores: sSupervision, Creativity, Organization, 
Research, Engineering, and Salesmanship--SCORES. AMERICAN INSTITUTES 
FOR RESEARCH. 


Development of Alternate Form of the Career Qualification Batvery 


For each of the nine types of CQB items twice the number were 
developed ani administered to 300 college students along with two 
existing forms. FORT MEADE PROCUREMENT DIVISION, DEPARTMENT OF THE 
ARMY. 
Achievement Tests for Navy Officer Candidate Programs 
Construction of comprehensive achievement tests for officer candidates 


to measure abilities in solving technical and professional problems, and 
in making sound decisions in novel situations. OFFICE OF NAVAL RESEARCH. 


Selection, fraining and Evaluation of Navy Officers 


A program of research on male and female officers of the Navy including 
the collection of critical incidents of performance, background variables, 
peer ratings, and OCS disenrollment; and the development of predictive 
tests and situation performance problems. OFFICE OF NAVAL RESEARCH. 
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Scientific Aptituse Test 


The development of an aptitude test for the selection of scientific 
personnel, in order to measure potentiality for research work in terms 
of predicting specific critical research behaviors. OFFICE OF NAVAL 
RESEARCH. 


Aptitude Tests for Air Trattic Control Personnel 


Development and validation of a test battery based on job analysis 
and criterion behavior specifications, designed to screen candidates 
for jobs in Air Traffic Control. NATIONAL ACADEMY OF SCIENCES §& CIVIL 
AERONAUTICS ADMINISTRATIONS. 


Navy Testinz 

Evaluation of paper-pencil tests developed to replace certain 
apparatus tests used by the Air Forces for the selection and classi- 
fication of aircrew personnel. OFFICE OF NAVAL RESEARCH, MEDICAL SCIENCES - 
DIVISION. 


Development of Alternate Forms of the Armed Services Vocational 
Aptitude Battery 


Development and preparat/on of 2,700 items for use in eight 
subtests for new forms of the ASVA3. DEPARTMENT OF THE ARMY. 


Measuring Nonintellectual Aspects of Officer Aptitude 


Development, analysis, and validation of tests to measure nonintel- 
lectual aspects of officer aptitude. Findings of previous work involving 
analysis of critical incidents of successful and unsuccessful officer 
performance were examined to provide systematic and explicit definitions 
of nonintellectual behavior. U.S. DEPARTMENT OF THE AIR FORCE, AIR 
TRAINING COMMAND, HUMAN RESOURCES RESEARCH CENTER. 


Development of Valid Situational Tests of Leadership 


Observation of ''Leuders Reaction Test" administration and scoring 
procedures at three dirferent Army posts indicated the necessity of a 
redefinition of infantry noncommissioned officer leadership requirements 
and a means for scoring obdserved performance. A new test was developed, 
on the basis of critical incident data, and tried out. Incidents were 
furnished by experienced infantry nersonnel describing situations 
indicative of both highly effective or ineffective leadership behavior, 
both on maneuvers and in actual combat. U.S. DEPARTMENT OF THE ARMY, 
ADJUTANT GENERAL'S OFFICE. 


Situations] Provlems for Junior Naval Officers 
Development and vilidation of a series of situational performance 
problems to measure leadership and human relations skills essential for 


effective junior Navy officers, and for training in effective leadership 
behaviors. U.S. OFFICE OF NAVAL RESEARCH. 
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Dev - pment of Service Personnel Selection Tests 

Froject to develop aptitude tests for predicting success in such 
service occupations as hotess, receptionist, flight attendant, and so 
on. UNITED AIR LINES. 


Development of Selection Procedures for ,IBM Processing Division 


The review of current selection procedures and the revision of 
pre-employment tests in the light of changing personnel requirements 
in the IBM Data Processing Division. IBM DATA PROCESSING DIVISION. 


Construction of Examinations for Post Office Department Supervisory 


Personnel 


Construction of tests including the following areas: cleaning, 
security, telephone opetation and elevator operation. Tests were 
constructed for supervisors in the Postal Field Service and in occu- 
pational areas of Building Services. POST OFFICE. DEPARTMENT. 


Police Selection and Training 


A four-year project to study the selection and training of police- 
men in New York City. Purposes: identification of critical requirements 
of police work; development of selection tests and training procedures 
based on rationales relating critical requirements to personality and 
role-learning variables; validation of these instruments and procedures 
as a means of predicting or prohoting effective job performance of police - 
recruits; follow-up ‘studies of training. C-29. RUSSELL SAGE FOUNDATION 


and ROCKEFELLER BROTHERS FUND, INCORPORATED. 


Preparation of 100 Test Ite:s for Revised AFROTC Exam 

Development of test items (multiple choice, short answer, and 
essay types) as well as scoring keys and suggested item scoring weights 
for u-e in the AFROTC Comprehensive Examination. HQ, AFROTC, MAXWELL 
AIR FURCE BASE. 


Leader Selection 


Determination of requirements and methods for recruiting, selecting, 
and training of shelter leaders and managers. OFFICE OF CIVIL DEFENSE. 


Stondardization of Job Corps Testing Procedures 


Preparation of a manual for test administrators at Job Corps rural 
camps and urban centers. OFFICE OF ECONOMIC OPPORTUNITY. 


Test Battery Validation 


Validation of aptitude tests used in the qualification of individuals 
for a variety of jobs at ‘ason and Hanger-Silas Mason Co., Inc., 
Plantex Plant. Jobs incluce most of the manual hourly-rate employees 
as well as certain clerical employees. bork will include: (1) study 
of the jobs, (2) the devalopnent of a task performance yatings; (3) selec- 
tion test acsinistration, nd (4) an analysis of the interrelationships. 
MASON AND HLAC.GUR-SILAS “NASON CO., INC. 
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Test Battery Evaluation 


A study to develop information for reducing three selection 
and placement batceries to one multiple-purpose battery. U.S. ARMY 
SIGNAL PROCUREMENT OFFICE. 


Validation Studies of the Peace Corps Selection Process 


An analysis of the assessment process used in selecting volunteers 
for the first eighteen Peace Corps projects; based on available criteria 
of success in training and in overseas job performance. THE PEACE 
CORPS. 


Development of Tests for Peace Corps Selection 


Development of a biographical information questionnaire designed 
to predict which applicants are most likely to operate effectively in 
performing Peace Corps projects. THE PEACE CORPS. 


Development of the Airman Qualifying Examination-62 (AQE) 


Development of an alternative form of the Airman Qualifying Examination 
including items paralleling the current form AQE-F, within the limits 
imposed by the item pools at the Personnel Laboratory. New items were 
developed for Airman Arithmetic and Technical Data Interpretation since 
there was no item pool available for their content. PERSONNEL RESEARCH 
LAB., AEROSPACE MEDICAL DIVISION, AFSC. 


Panel Interview Procedures for Selection of Civilian Supervisors 


Development and validation of interview procedures for the selection 
of blue-collar foremen in’ Army Depots and performance test procedures 
for these Wage Board supervisors. DEPARTMENT OF THE ARMY. 


Literature Search on Three Tests 


A literature search was conducted on the Wonderlic Personnel Test, 
SRA Non-Verbal Test, and the Bennett Mechanical Comprehension Test. G-8. 
AMERICAN CIVIL LIBERTIES UNION, LAWYERS CONSTITUTIONAL DEFENSE COMITTEE 


Research on the Professionul Placenent and Occupational Placement Batteries 


A battery of 21 paper and pencil tests and inventories was developed 
for use in placement of personnel in selected professional jobs. A battery 
of aptitude tests for selection and placement of personnel for clerical and 
mechanical jobs was also developed. Four studies were conducted: to make 
these tio batteries operational; to develop an interview schedule and 
rating scale for use with other instruments in the placenent of newly hired 
personnel]; to devélop an experimental form of an interest inventory, and, to 
refine the various instruments. B-16, B-23, B-33, B-34, B-35, B-36. U.S. 
DEPARTMENT OF THE ARMY, SIGNAL CORPS 
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Improved Medical Examination 


Development and evaluation of a revised Part III medical examination, 
designed as an experimental test of clinical performance for administration 
to physicians at the end of their internship year as a prerequisite for 
licensure. C-21. NATIONAL BOARD OF MEDICAL EX/MINERS 


Development of an Objective Engineer-in-Training Examination 


Development and evaluation of an objective multiple-choice Engineer- 
in-Training Examination designed to test knowledge of fundamental engineer- 
ing subject matter. The examination, the first step toward licensure as a 
professional engineer, has two parts: Part I consists of Mathematics, 
Physics, Chemistry, Economics, and Electrical; Part II consists of Mechanics, 
Kinetics, Thermodynamics, Fluid Mechanics, and Strenzth of Materials. F-S. 
STATE REGISTRATION BOARD FOR PROFESSIONAL ENGINEERS OF THE COMMONWEALTH OF 
PENNSYLVANIA é 


D.0.T. Training Materials 


The development of a course of self-instructional materials to 
assi.. the Bureau of Employment Security in instructing for the use 
of t..e Dictionary of Occupation- Titles. BUREAU OF EMPLOYMENT 
SECURITY, U.S. DEPARTMENT OF LAE 


Application of Self-Instructional and Programmed Procedures to the 


"Physical Demands Analysis" Portion of Job Analysis Training 


* 


A study to assess the feasibility and operational benefits of 
applying self-instructional procedures to specific Bureau of Employment 
Security training programs. * BUREAU OF EMPLOYMENT SECURITY, U.S. 
DEPARTMENT OF LABOR. 


Workshop on the Use of the Critical Incident Technique in Job Analysis 


Development and presentation of a workshop on the use of the critical 
incident technique in job analysis. Lectures, discussions, and practice 
in development and application of tasks essential to carrying out critical 
incident studies, and other data collection procedures. G-38. BELL 
TELEPHONE LABORATORIES 


Develoscment of the Performance Record 


Tne development of the Performance Record, an empiovee proficiency 
measurenent device, from an extensive survey of effective and ineffective 
critical job incidents. GENERAL MOTORS CORPORATION. 

& 


Evaluating Officer Effect’ veness 


Development of a procedure for eyeiunri ey the effectiveness of 
Air Force officer performance by means of the critical incident technique 
in order to incerporate a system of promotion based on officer merit. 
AIR SURGEON GENERAL'S OFFICE. 
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Generalization of Relationships Between Task Characteristic Index 
and Criterion Measures 


During this third phase of the research, the relation between task 
indices and training effectiveness criteria will be studied in the lab 
and field. The interaction of traini:g variables and task indices will 
be explored and application of the indices will be expanded to include 
other types of devices. NAVAL TRAINING DEVICE CENTER, DEPARTMENT OF THE 
NAVY 


Development of Task-Level Job Performance Criteria 


A forty-month effort to develop and try out a system for Airman Job 
Performance Measurement at job task level for ultimate use as research 
criteria for the evaluation of selection, training, and other aspects of 
personnel programming. AEROSPACE MEDICAL DIVISION, U.S. AIR FORCE. 


Job Standards tor District Superintendents 


The developm=nt uf objective standards of managerial performance 
to assist the supervisor in judging the actual performance of his 
managerial subordinates. AMERICAN TELEPHONE AND TELEGRAPH COMPANY. 


Power Company Orientation to Use ot Performance Record Procedures 

Introduction and oreintation to use of Performance Record procedures 
(to evaluate employee performance) for pe onnel of the Ohio Power Company 
of the American Gas and Electric Corporation. A-75. AMERICAN GAS AND 
ELECTRIC CORPORATION 


Objective Proficiency Check for Private Pilot Certification 


Development of an chjective flight-check to improve the measurement 
and evaluation of critical skills necessary for safe and efficient flying 
by private pilots. A critical incident analysis was used in developing 
this proficiency check for initial certification purposes. A-15, A-32. 
NATIONAL ACADEMY OF SCIENCES AND CIVIL AERONAUTICS ADMINISTRATION 


Air Traffic Control Performance 


Development and improvement ef procedures for evaluating the proficiency 
of air route traffic controllers, including a detailed analysis of the joo 
and the design of an evaluation form based on job requirements. Evaluation 
of "Air Traffic Control Performance Record" to deternine its reliability 
and consistenc, and its practicality for evaluating controlier proficiency. 
A-9, A-13. NATIO.‘A] ACADEMY OF SCIENCES AND CIVIL AERONAUTICS ADMINISTRATION 


Criterion Measures for Research Personnel 


Development of tests to measure proficiency in specific areas of 
scientific work. Inciuued development of the Observational Record Forn 
for Meseace! Mersonie!, manuals and training procedures for a field try-ot, 
to be used with a representative sample of supervisors”in governnentai 
laboratories. A-20. OFFICE OF NAVAL RESEARCH, HUMAS RESOURCES DIVISION 
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Indiana University, A.B., 1958 
The Ohio State University, M.A., 1960 
The Ohio State University, Ph.D., 1963 
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Phi Beta Kappa 
Signa Xi 


Professional Affiliations 
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Previous Experience 


During his graduate training, 
and was responsivle for constructing an 
human value acts and for factor analytical studies 0 
of data collected by those measures. 


Dr. Brumback served as a Research Assistant 
d testing paper and pencil measures of 
f - variety of samples 


Ohio Division of North American Rockwell 


Dr. Brumback joined the Columbus, 
a year as a research psychologist on 


Corporation in 1962 where he worked for 
problems of human information processing. 


Brumback joined the U.S. Department of 
Health, Education and Welfare in Washington, D. C., as a research psychologist. 
He was responsible for directing employment-centtéred research studies of 
commissioned officers in the United States Public Health Service. 


At the beginning of 1964, Dr. 


s both an in-house and external consultant 
he USPH3 Global Comnunity Health Career 
Development Program, the USPHS Nationai Health Service Corps, anu the 
National Oceanic and Atmospheric Agency. He has been a manuscript re- 
viewer for two scientific professional journals. 


Dr. Brumback also served a 
for several groups, including t 


A.1.R. Experience 


Dr. Brumback joined the Washington Office of A.I.R. early in 1975 
as a Senior Research Scientist in the Human Resources Research Institute. 
He is currently directing projects on models for job analysis and test 
developrent/valid-tion for one of the largest civil service employment 
systems in the country and is participating in the analysis of key 


occupations within the jaw enforcement and criminal justice fields. 
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Association District of Columbia Psychological Association 
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Previous Experience 


In 1954 and 1955 Mr. Hahn was a member of the Research Division of 
the South Central Home Office of the Prudential Insurance Company of 
America. In this positic: he was responsible tor planning and executing 
studies assessing market potential for new sales agencies, developing 
cost and expense control procedures for sales agencies, aualyzing consumer 
behavior and advertising effectiveness and selecting and training sales 
managers. 


A.I.R. Experience 


Mr. Hahn first joined AIR in 1949 under a researcn assistantship 
combining graduate study and research work. His activities as a project 
associate and later as a project director included studies concerning 
job and task analysis for military and civilian agencies, selection and 
classification test construction and validation and job performance 
evaluation procedures. 


In 1955 Mr. Hahn rejoined AIR as a Research Scientist. As a pro- 
ject director and subsequently Director of the Human Resources Research 
Program and its Accident Research Center, and currently as the Director 
of the Human Resources Research Group, he had directed numerous studies 
involving selection and classification instruments and procedures, 
situational performance tests particularly for ieadership and human 
relations skills, performance measurement ard evaluation, curriculum 
evaluation, training materials and procedures, attitudes and motivations, 
particularly as they apply to job and career satisfaction, system analyses, 
operations research analyses, and automotive, industrial, and home 
safety. Some of the studies with which he has been affiliated follow. 


He directed a three year study concerned with educational pregrams 
in correctional institutions. This primarily concerned youthful offenders 
serving indeterminant sentences but included other tynes of correctional 
institutions. This included work with the D.C. Department of Corrections 
Youth Center, the Maryland,State Penitentiary, the Massachusetts Correc- 
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tior.. | Institution, and the Draper Correctional facility in Alabama. He 
alsc worked with the Director of A.I.R.'s Center for Research in the 
Admii istration of Justice in developing plans for other projects. 


He has been involved in the development of achievement test items 
on areas of skill and knowledge suitable for grade levels 1-9 for use 
with educationally deficient adults to determine achievement levels in 
relaiion to level needed to obtain and hold gainful employment; developing 
techniques for assessing reading and writing effectiveness for USAF 
personnel: and development of a proficiency test for use in the operation 
and maintenance of the Navy's SUBROC system. > 


Mr. Haka was concerned with studies evaluating program effective- : 
ness. One evaluation was of the Frankiin Institute to deter:i‘.¢ the . 
extent to which the program met its objectives of arousing an i rest 
in science in its students. Another was conducted for the Naticu1 
Science Foundation's Summer Science Training "rogram following « par- 
ticipants to see if the program accomplished its goal of encoure zing 
talented high school students to pursue careers in science oN 


He has been involved in studies of test development au. valic on, 
selection procedures and measurement. One of these projects as <. «cerned 
with measurement of individual differences in respect to critica! Jircrew 


job requirements. He helped develop a Professional Placement Batrerv of Ae 
tests and inventories fer personnel classification n selected p1.~ -sicaa!} F 
jobs and an Occupation Placement Battery of aptitude tests for cler. ¢1 i. 
and mechanical personnel. << 


His involvement with self-instructional materials has concerned a 
study to demonstrate the feasibiiity ana effects of using a variety of 
self-instructional vrocedures 1n correctional * istitutions; application Ms 
of self-instructional learning procedures to the '’nysical Demands 
Analyses"’ portion of Job Analyses Training; and training and supervising 
Census Bureau personne!) in the development of self-instructional home 
Study materials for training enumerators in précedures for the 1964 : 
agricultural census. 


He has directed or participated in projects concerning leadership. 
Several of these were sponsored by the military. One study developed 
and validated a series of situational problems to measure leadership and 
human relations skills essential for junior Naval officers, and a second 
developed procedures and training materials including situational problems 
for leadership training of Petty Officers. 


Studies involving curriculum research included an Ai: Force Academy 
research study providing information on skills and knowledge requirements 
and career motivation facturs associated with officer jobs at various 
levels in a variety cf major commands. Another study developed guide 
lines concerning the application of advanced educational technology of 
learning such as programmed instruction and CCTV for use in Marine Corps 
schools and tra2ining activities. Also developed for the Marine Corps 
was a nethodology to enable Marine Corps personnel to systematically 

evaluate technical schools for erlisted personnel. 
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, Some personnel and training studies included the feasibility of 
using information in Air Force officer personnel files for identifying 
quaijification variables relevant to success in selected officer specialties. 
There was a study for the Navy on the application of operations research 
techniques to an analysis of the Navy personnel system resulting in a 
model capable of simulating policy changes and their effects upon person- 
nel supply; a study in Government and industry involving the co'lection 
and evaluation of personnel and training information in terms of its 
implications for military personnel and trainisg problems; and a project 
reviewing selection procedures and revision of pre-employment tests for 
data processing personnel in a company because of changing requirements. 
There was also a rather large study of personnel research on selection 
and training procedures for a number of businesses concerning the value 
of various programs of management development carried out by successful 
industrial organizations to ensure an adequate supply of managers. 


In the area of industrial, automotive, and home safety, Mr. Hahn 
directed or participated in several major studies. One of these con- 
cerned the development of recommendations for a research program on the 
human factor aspects »f highway safety. Another concerned the development 
of a national program to encourage increased use of automotive restraint 
systems. Three studies were concerned with driving behaviors and modi- 
fying such behaviors using simulators and filméd techniques in teaching 
self-perception to drivers. He directed a study analyzing Army accident 
data for exploitable relationships that would lead to recommendacions 
for future routine analyses of such data which might be helpful in 
reducing the number and severity of accidents. Another study concerned 
behavioral compromises of safety made and allowed by production workers, 
supervisors, staff personnel and upper management in government and 
privately run munitions p!ants. Critical incident data and the use of 
incomplete sentences provided information on the kind of compromises 
made and the frequency. He was also concerned with a conference of top 
scientists on various aspects of research on childhood accidents. 


Mr. Hahn served as a member of an advisory panel for an A.I.R./Na- 
tional Highway Traffic Administration project to develop standards for 
driver training simulators, ranges, and modified vehicles. He also 
served on an advisory panel for the American University/National Traffic 
Safety Administration U. S. Coast Guard Driver Training Project. He has 
also served as a consulting editor for Behavioral Research in Highway 
Safety and as a member of the Highway Research Board E‘fectiveness of 
Operational Measures Committee. 
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Dr. Edwards taught introductory, experimental, and educational 
psychology, motivation, and statistics at the Woman's College of the 
University of North Carolina from 1947 to 1948. 


For four years she was with the Department of the Army, Person- 
nel Research Branch, AGO, (now the Behavior and Science Research Labor- 
atory) as a Research Psychologist working on a variety of military 
personnel problems primarily concerned with rating techniques for both 
predictor and criterion variables. 


She was with Western Reserve University from 1952 to 1954 
as a Research Associate in the Personnel Research Institute where she 
was involved with personnel research for industrial concerns. This 
included test development and evaluation forms, primarily, with some 
experience in personnel audits. 


For the next two years she was with the Department of the Air 
Force, Directorate of Civilian Personnel, Civilian Personnel Research 
Branch. She served as a project director for development of Job 
Information Tests for all Air Force Wage Board positions and also 
directed smaller projects concerning turnover in civilian personnel 
offices, and preiiminary validation of a personality inventory for 
selection of personnel for overseas positions. 


From 1958 to 1963 Dr. Edwards taught Introductory Psychology 
at the University of Virginia Extension Division. 
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Program and Associate Director of the Accident Research Center. She is 
also the Director of the Washingt 91 Office Testing Center which is respon- 
Sible for administration of the Aircrew Selection Battery, sometimes known 
as the Stanine Tests. 
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She has participated in and directed mmerous projects involving edu- 
cational research. These have included evaluation of the AFROTC curriculum 
and development of new measuring instruments for use by Hq. AFROTC to deter- 
mine the extent to which their program was meeting its st-ted objectives 
both in terms of cognitive skills and knowledges and attitudes and motiva- 
tions toward careers is. the Air Force. She is presently directing a project 
sponsored by the National Institutes of Mental Health to evaluate the educa~ 
tinal effects of a toy lending library on culturally disadvantaged children 
in a Washington, D. C. ghetto area. 
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Dr: Edwards directed a project for the Bureau of Employment Security 
of the Departinent of Labor involving the development of self-instructional 
training materials for use in training BES and other government personnel 
in the use cf the new edition of the Dictionary of Occupational Titles. 


ve has been involved in projects of test development, validaticn and 
sei ion procedures involving populations from a wide range of academic 
and socio-economic backgrounds. She participated in projects developing 
test batteries for high school students in Project TALENT, for selection of 
air line hostesses, and developed items for alternate forms of the 
Armed Services Vocational Aptitude Battery. She was involved in developing 2 
Professional Placement Battery of tests and inventories for personnel class~ 
ification purp* + on selected jobs and for an Occupation Placement Battery 
consisting of . ..tude tests for selection and placement for clerical and 
mechanical jobs. These batteries were validated and refined instruments 
developed. A manual was prepared for test administrators at Job-Corps rural 
camps and urban centers. This pirject was followed by a second which re 
vised the manual to accommodate changes made in Job Corps testing programs. 
Then a parallel manual was developed for use in the Women's Centers after 
review and revision of Job Corps tests for female enrollees. She has also 
constructed tests for Post Office supervisory personnel, the Signal Procure- 
ment Office, and a Career Qualification Battery for a Department of Defense 
agency. 


She has directed or participated in four studies involving industrial 
and automotive safety. Three of the studies were funded by the Public 
Health Service. The first involved improving public safety through obser- 
vation of driving behaviors without the drivers’ knowledge; the second 
involved the application of movie techniques to determine the effects f 
training in self-perception on driving behaviors; and the third study was a 
comparison on on-the-street performance of drivers with performance: driv- 
ing simlators to determine what driving behavior is reproduced and ether 
the simulator provides a realistic sample of road performance. The ourth 
study was performed in military and privately run munitions plants 4 
determine the nature and frequency of behavior compromises of safe'y made 
and allowed Ly production workers, supervisors, staff personnel and upper 
management. 
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Dr. Edwards was Project Director of a Study to develop certification 
examinations for Therapy Aide positions in the New York Department of 
Mental Hygiene. Prior to test development, this project required face- 
to-face in-depth interviews with employees and superv‘scrs of mental 
hospitals and state schools for the retarded throughout New York State. 
Subsequently test items and training materials were developed for three 
subject matter areas--Communications, Math and Mental Health and Hygiene. 
This test was used for certifying Therapy Aides for promotion, and was 
built according to criterion-referenced test principles. 


She has recently completed a study of the Civil Service Commission 
Worker Trainee program aimed at identifying characteristics of good and 
poor workers in low level unskilled jobs. The project involved inter- 
viewing and surveying about 1000 workers and their supervisors. 


Dr. Edwards is currently Project Director for two test development 
projects sponsored by the U.S. Army Research Institute. One is con- 
cerned with development »f an item pool for the AFQT, the other for 
development of an item pool for the ACB. 
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Previous Experience 


. Prior to college, Mrs. McNelis was employed for five years as a writer 
and producer of radio and television commercials for a Washington advertising 
agency. After college she completed several consulting assignments for a 
number of research organizations in the Washington area including Performance 
Research, Inc.; Computer Applications, Inc.: and the Educational Research 
Project and Psychological Clinic of the George Washington University. Pri- 
marily these assignments have involved developing tests, questionnaires, and 
training manuals in both self-instructional and traditional formats for a 
wide range of subjects such as children, disadvantaged adults, and college 
graduates. While in graduate school she served as a Research Counselor at 
the Psychological Clinic of George Washington University where she inter- 
preted test results and provided academic counseling for students. 
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A.I.R. Experience 


Mrs. McNelis joined A.I.R. in 1961. She has participated in a number 
of studies in the area of content analysis. These include studies to deter- 
mine the feasibility of predicting success in officer jobs from Air Force 
Personnel records and for predicting success in Peace Corps jobs from the 
narrative sections of Peace Corps application forms. For both of these studies 
she participated in the development of category systems suitable for content 
analyses and data processing. 


In the field of testing, she has contributed to the development of 
achievement tests for grade levels 1 through 9 for use with educationally 
deficient adults; develoned test items for alternate forms of the Armed 
Services Vocational Aptitude Battery (ASVAB); and test items to be used 
in the selection of supervisory personnel for the U. S. Post Office Depart- 
ment. 
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Mrs. McNelis has also been involved in training and education. In 
the field of programmed instruction, she contributed to remedial arithmetic 
and seading manuals for a group of youthful offenders in a local correctional 
institution, to > two-volume manual to teach Department of Labor person- 
hei how to use the Dictionary of Occupational Titles; and to a semi-pro- 
grammed text to help college students develop effective study habits. Other 
educational endeavors involve the Operation and evaluation of a Toy Lending 
Library for very young children and the evaluation of the correlated curric- 
ulum project for Junior High School students in New York City. 


In the field of job evaluation, Mrs. McNelis served as Project Director 
On a study to develop and administer an experimental mailed questionnaire 
to predict rank and grade of U. S. Air Force officers. This involved the 
primary responsibility for questiounaire development, administration of a 
large-scale mail Survey, data collection, and the preparation of the project 
report. Also in the survey field, she has developed questionnaire items and 
interviewed in-person Subjects with a wide range of socio-economic back- 
grounds. One such project, funded by the U. S. Civil Service Commission, 
involved the interviewing of several hundred disadvantaged and their super- 
visors participating in the Worker Trainee Progran. 


The studies described above have included some or all of the following 
activities: task analysis, development of criteria, development and admin- 
istration of project materials, data analysis, and reporting of project 
results. 
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TANIA ROMASHKO 
Associate Research Scientist 
Human Resources Research Group 


Education 
babies 


Michigan State University, B.A., 1966 
Michigan State University, M.A., Political Science, 1967 


Previous Experience 


In 1963, Miss Romashko was a Statistician at Royal McBee Corporation, 
responsible for preparing budgets, quotas, weekly, bi-weekly and nonthly 
reports of actual versus projected sales and performed other analyses. 


At Foot, Cone & Belding, from 1963-65, she was an Audio-Visual 
Specialist, Operating various types of audio-visual equipment. She 
recorded, edited, dubbed and mixed audio tapes and edited films. 


Miss Romashko was a Research Assistant at Michigan State University 
where she conducted a 10-year content analysis of Chinese Mainland maga- 
zines to identify changes in emphasis of various types of social, politi- 
cal and economic relationships. She performed statistical analyses of 
Chinese refugee data. Miss Romashko also reviewed and evaluated previous 
research on the effects of threat induced by written and ora] communica- 
tion. She coauthored an introductory programmed text on information 


At Honeywell, Inc.. she was an Electronic Data Processing Trainee 
and operated computer and peripheral equipment. She also wrote machine 
language programs for the Honeywell 1200 computer system. 


A.I.R. Experience 


sensory, psychomotor and Physical abilities as one system of Classifying 
tasks. She was involved in a series of interlocking studies to evaluate 
the effectiveness of the abilities approach for organizing and generali- 
zing research results for an area of experimental literature. She was 


extent to which abilities could differentiate task performance and the 
extent to which such performance could be differentiated with respect to 
selected independent variables. 


She is presently involved in a series of interrelated projects for 


New York City involving the use of a Variety of job analysis techniques 
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demands analysis, job inventory, critical incident technique and the 
Position Analyses Questionnaire. She has participated in the comparison 
of various job analysis procedures for test development for personnel 
selection. She is primarily concerned with the development of a proce- 
dure to validate physical tests for a variety of City jobs with physical 
requirements. 


She has also been involved in the job analysis and subsequent test 
development for promotion to Therapy Aides i1 New York State. 


Selected Bibliography 


Theologus, G. C., Romashko, T., §& Fleishman, E. A. Development of a 
taxonomy of human performance: A feasibility study of ability dimen- 
Sions for classifying human tasks. Technical Report No. 5S. Washington, 
D. C.: American Institutes for Research, 1970. 


parpy, C. A., Korotkin, A. L., & Romashko, T. Survey of computing activ- 
ities in secondary schools. Final Report. Washington, D. C.: American 
Institutes for Research, 1970. 


Romashko, T., Brumback, G.B., Fleishman, E.A., §& Hahn, C.P. The Develop- 
ment of a Procedure to Validate Physica! T*sts: Physical Requirements 
of the Sanitation Man's Job. Washingtc -€.: American Institutes for 
Research, 1973. 


Romashko, T., Brumback, G.B., Fleishman, E.A., & Hann, C.P. The Develop- 
ment of a Procedure to Validate Physical Tests: Physical Requirements 
of the Parking Enforcement Agent's Job. Washington, D.C.: American 
Institutes for Research, 1974. 


Romashko, T., Brumback, G.B., Fleishman, E.A., & Hahn, C.P. The Develop- 
ment of a Procedure to Validate Physical Tests: Physical Requirements 
of the Fireman's Job. Washington, D.C.: American Institutes for 
Research, 1974, 


Romashko, T., Brumback, G.B., Fleishman, E.A. & Hahn, C.P.. The develop- 
ment of a procedure to validate physical tests. Final Report. 
Washington, D.C.: American Institutes for Research, July 1974, 


Brumback, G.B., Romashko, T., Hahn, C.P. & Fleishman, E.A. Models for 
Job Analysis, Test Development and Validation.Procedures. Final] Report. 
Washington, D.C.: American Institutes for Research, July i974, 


459a~i 


Transcript of Hearing before 
Judge Tyler, dated January 14, 1975 


ino a 


10 - gnineneciaeiaaaesteitaesateatteaeainatinaniianinenarinnannemetinnisaiaintdtinemimmmiisiitiainammmmmmnaaiinimE 


459a-2 
jgesb 
UNITED STATES DISTRICT COURT 


SOUTHERN DISTRICT OF NEW YORK 


Beston M. Chance, Louis C. 
Mercado, et al, 


Plaintiffs, 
vs. 
The Board of Examiners and the 
Board of Education of the City of 


New york, et al, 


Defendants. 


Before: 


HON. HAROLD R. TYLER, JR., 


* 


76 Civ. 4141 


District Judce 


January 14, 


APPEARANCES: 


Elizabeth B. DuBois, Fsq. and 
Jeanne R. Silver, Esq. 
Attorneys for Plaintiff 
By: Jeanne R. Silver, Fsq., of Coun 


Adrian P. Burke, Esq. 


4:15 p.m. 


sel 


Corporation Counsel, City of New york 


Attorney for Defendant Board of Fducation 


By: Leonard Bernikow, Fsqa., 
Assistant Corporation Counsel 


Teelted: OURT REPORTER S$. COURTHOUSE 


1975 


21 


jgesb 
APPEARANCES (Continued) 


Kaye, Scholer, Fierman, Hays & Handler, Fsqs., 
Attorneys for Defendant Board of Examiners 
By: Saul Z. Cohen, Esq. and 
Howard A. Jacobson, Fsq., of Counsel 


Frankle & Greenwald, Esas., 
Attorneys for Council of Supervisors and 
Administrators 
By: Leonard Greenwald, Esq., of Counsel 


Michael A. Rebell, Esa., 
Attorney for New york City School Boards 
Association 
Amicus Curiae 


-900- 


SOUTHERN DISTRICT COURT REPORTERS, U.$. COURTHOUSE 


~3 


mR Ye 8B RB 


1 caustic Oe 
- ne ernnneaesonnnnenenr=erenennanetreiansnessenssnesr=oouseanesetnersSereernensaessessesseessnaasste 


459a-4 


[page 4] 


MR. COHEN: your Honor, just to refresh your 
recollection as to the state of the proceedinas, on 
December 20th, we filed a notice of motion askina the Court 
to consider a final plan for examinations for st» rvisory 
positions in the New fork City school system, we, meaning 
the Board of Fxaminers, and that motion was joined in by 
the Board of Education. 

The plan that was submitted was an exact copy 
of a plan submitted earlier jointly by the parties, only 
in the earlier plan there were two exceptions that the 
plaintiffs -- two reservations that the plaintiffs had 
made, one with respect to the desiqnation of consultants 
and the other with respect to the question of reporting. 

And since those questions could not be resolved 
by negotiation, the defendant Board of Fxaminers and the 
defendant Board of Fducation submitted their plan and dea t 
#ith those subjects. 

Subsequently, the plaintiffs submitted a motion 


ir. opposition to the defendants’ motion and submitted their 
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own plan with a different treatment of those two subjects, 
but again the plan submitted is the identical one 
submitted to the Court earlier as a joint submission. 

And then, today, the Board of Examiners and the 
Board of Education have submitted opposing affidavits to 
the plaintiffs’ earlier submission. 

So we are here today to arque about «he two 
unresolved matters that emanated from our earlier 
submission, and each side has submitted its proposals for 
how those natters should be resolved. 

I think the matters are described in the papers 
that are submitted and I don't want to burden the Tourt 
with an unnecessary repetition, but I think I should just 
quickly summarize the position of the Board of Fxaminers. 
And while the Board of Education has its own counsel, I am 
informed that their position doesn't differ from ours. 

THE COURT: Yes. I just received from Mr. 


Bernikow an affidavit which he just filed which indicates 


4 


1 
as much. 


MR. COHEN: During the intensive negotiations 
that took place over a period of more than a year and a 
half to try and arrive at a suitable plan, one that could 
be agreed on by all of the parties, the parties aqreed that 


at various points in the plan consultants would he used to 
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do certain tasks. 
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In the case of the Board of Education, a 


consultant was to -e used to develcp job analyses, which _ 


are important for the development of the subsequent 


examinations. 


In the case of the Board of Examiners, they 


agreed that they would use a consultant to develop certain 


procedures for validating exams which were developed. 


However, in the negotiations the parties couldn't 


agree on either a consuitant or on a method for selecting 


a consultant. The plaintiffs uraqed chat the matter be one 


of mutual agreement or in the absence of mutual agreement 


that it be subject to some form of arbitration with an 


TRE COURT: 
go any further. 
MR. COHEN: 


that with respect to 


impartial third party -- 


No. 


All right. 


consultants, 


I understand you don't have to 


And our basic point is 


it was left on the basis 


that we were going to choose our consultants, we put a 


blank in there because we hoped that when we told the 


plaintiffs who the consultant was, they would aaree and, 


therefore, the problem would qo away. 


Unfortunately the problem did not go away because 


apparently they raise objections to the designated 


hy 
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consultants, and neither the Board of Fxaminers nor the 
Board of Education is prepared to cede the authority and 
responsibility it has to prepare these exams by giving up 
its right or sharing its right to desiqnate a consultant. 

Now, with respect to reporting, we have had 
endless meetings on the subject of reporting, and basically 
the problem boils down to a simple proposition. 

The defendants say that the plaintiffs are 
entitled to reasonable information to permit them to 
determine whether the defendants are abiding by the order 
that will emanate from the Court or fulfilling the 
obligations of the plan. 

But it seems to defendants that what the 
plaintiffs are seeking is to become partners with Hie Board 
of Examiners and the Board of Education in developing a 
plan and that they are seeking such a degree of infc mation 
that we see ourselves involved with them on a continuing, 
virtually daily basis, where there approval will be 
required at virtually every step of the way. 

We see that this situation will lead to endless 
negotiations, that we will not get the plan off the ground, 
that we will find ourselves back in this Court sbonink 
about every jot and tittle of the development of this 


program, and the whole proqram which has already been 
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delayed for almost five years will be delayed even further. 

And we think the proposals they are makina with 
respect to reporting are unreasonable, go far beyond what 
any plaintiff is entitled to expect, and that they should 
not be accepted by this Court. 

MR. BERNIKOW: Your Honor, as you see from my 
affidavit, we join in Mr. Cohen's remarks and his 
submission. 

We have also submitted a copy of a proposal of 
our consultant as well as some backaround material ahout 
the consultant, his related experience as well as some 
resumes of some of the people -- 

THE COURT: You are taiking about Development -- 

MR. BERNIKOW: No. That is the Board of 
Examiners‘ 

THE COURT: That is why I asked. f£ ama little 
confused. Your consultant is whom? 

MR. BERNIXOW: My consultant is A.I.R., and we 
submitted their proposal as well as some backaround 
material about this allegation, its related experience, as 
well as resumes of the principals of the firm, the people 
that will be working on this proposal. 


MRS. SILVER: Your Honor -- 


THE COURT: Now, once aqain, as I frequently am, 


1: ahetiasanmanicopentieen 
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2 I am a little taken aback. Where is Miss DuBois? 
3 MRS. SILVER: She had another engagement tod.cy. | 
4 Professor Cooper is here, and I am here, speaking for the 

| 
5 plaintiffs. ! 
6 As you will see in the papers, it contains my | 
7 affidavit. Some statements have been made about Pr. | 
8 Cooper's participation in the negotiations, and he is here, | 
9 too. | 
10 THE COURT: Again, my concern is that as I am : 
11 constantly thrown off, although I am well aware that | 
12 Professor Cooper and you are here and you are certainly | 
13 counsel of record, and I don't want to sound uncharitable, 
14 but I'm always confused because of the conflicts that I | 
15 see, and very consistently see, between having one lawyer , 
16 in one phase of this and then he or she gets out and ! 
7 another lawyer -- it has been not an abundant joy. | 
18 But how do you want to handle this? You want to 
19 both argue? 
2 MRS. SILVER: No, your Honor. 
21 THE COURT: Who wants to arque? | 
ae MRS. SILVER: I want to arque. | 

a. THE COURT: All right. 
: %A MRS. SILVER: We have consulted fully on these 

25 


papers, and in any matter where there is any possibility 
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that I was not present on an operative important occasion, 
these matters have all been mutually verified. 

However, it is true, as ‘Ir. Cohen points out, 
that the negotiation, the extensive neqotiation of 
reporting provisions took place primarily in person hetween 
him and me. 

your Honor, I think the area of difference just 
with respect to the point that Mr. Cohen made is that he is 
talking about delay in effecting a permanent, viable, 
valid licensing system, and plaintiffs submit -- 

THE COURT: Yes, because an outsider from Mars 
or wherever could say that the position of the plaintiffs 
on both the reporting and the consultant seems to be 
somewhat inconsistent to the interests of their class. 

It does seem to build in all kinds of continuing 
echoes: and heaven knows we have had a plethora of 
those since I have known you, and this would only be a 
built-in guarantee of five to ten years more. 

MRS. SILVER: No, your Honor, I respectfully 
submit the contrary. 

The interest the plaintiffs have is in getting 
a valid and nondiscriminatory licensing system as soon as 
possible and to that end we have striven very hard to reach 


an agreement on the basic guidelines and have concurred in 
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this basic plan. 

In accordance with the decisions of the Courts 
in the circuit and others on testing cases, we are 
entitled and the Court is entitled to be assured before a 
new test is administered that the test is valid and 
job related, at least to the extent that content 
validation procedures can assure that before the test is 
administered. 

And in the Bridgeport case in this Circuit, in 
the Vulcan case, the Second Circuit has said that it is 
appropriate that plaintiffs and the Court see either tests 
or the substantive material that bears on the question of 
validity in advance. ' 

In a case relied on by this Circuit, Castro v. 
Beecher, decided in the First Circuit, the Court said that 
the plaintiffs and the Court were entitled to be assured 
in advance that the test was valid in accordance with 
EEOC guidelines. 

Now, the reporting provisions submitted by the 
defendants here do not afford any of the relevant 
information in advance of test administration except job 
analyses. Certainly job analyses are crucial to a 


deternination of validity, but alone they do not establish 


that a test is valid. 
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So what defendants are asking your Honor to do 
is to caine them to administer tests hefore submitting 
that material. After that, they urge the Court and the 
plaintiffs to consider the validity of the tests which will 
by then have been administered to thousands of people.’ 

And we submit, your Honor, that that is not the 
way to avoid delay, te litigate the validity of tests 
after they have been administered is indeed a way to slow 
down the entire process. 

The administration itself will take a great deal 
of time and certainly greater burden will be imposed on a 
Court which is forced to decide the validity of tests that 
many people have invested a lot of time, money and eneray 
in taking and giving. 

That is the crucial point of difference. 

Our position on the consultants is qeared to the 
same objective. The affidavit of our expert states what I 
think is obvious, that the way a consultant performs the 
job analyses is as important as his own paper qualifications 
in determining whether it will be the basis for a valid 
test, and we submit that it would be desirable for 
everybody to examine the qualifications and the intentions 
of the job analysis firms certainly before the job analysis 


is performed. 
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We at the moment, your Honor, have no specific 


substantive objections to the firm designated by the Board 


of Examiners, Development Dimensions, to do job validations. 


On the other hand, we are in the same position 


in regard to that firm as we are in regard to A.I.R. 


We haven't got any information at ail on the basis of which 


we could gauge theirintentions. 


i 


We think that it would be conducive to expediting 


progress here for this information to be furnished to us 
and to the Court in advance. 

Now, the defendants reporting provisions also 
omit to provide for furnishing any significant information 
whatsoever about the crucial second step of the examina- 
tion process which the parties have agreed should be a 
2-step procedure. 

They also omit to require the furnishing of any 
information on the many other tests for other positions. 

We have been very modest in our requests. We 
have only asked that the latter category of information be 
furnished to us after the examinations are administered. 
We think that is a reasonable compromise because the 
protypical examinations are admittedly going to be the 
basis for all future examinations. But in effect the 


defendants, declining to give us what they term minutiae, 
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are declining to give us any information at all in 

the category in which this Court and the Second Circuit have 
held appropriate for submission in cases just like this 

one. 

I might add, your Honor, that this is perhaps a 
case where it will be more difficult after the fact to 
determine the validity of examinations. The other cases 
in this circuit have concerned much less complex, non- 
professional positions. In those cases possibly, if the 
exams had been administered and then the Court had found that 
they were invalid, it might have been relatively easy to re- 
do the whole process. But here the parties have agreed 
that ascertaining the qualifications of professional per- 
sonnel as at the level of school principals and supervisors 
is complex and difficult, and certainly it would facilitate 
getting that underway to examine the materials before 
all the people are tested. 

MR. COHEN: Your Honor ~~ 

THE COURT: You didn't say much about the con- 
sultants, Miss Silver. I must say I don't understand the 
plaintiffs’ position on that at all. It seems to me 
the Board should have the right to choose its own con- 
sultant. You are good enough to say that you have nothing 


against Development Dimensions, Inc., their apparent 
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choice. 

I really don't even understand that argument 
at all from your point of view. I really don't. 


MRS. SILVER: Let me try to explain, your 


Honor. The defendants’ only reason for saying that it shoule¢ 


be allowed to select these consultants is there insistence 
that they have the right to administer the licensing 
system and make that selection. 

THE COURT: Basically that's what the law 
Says. They do have the right. 

MRS. SILVER: That is what the law says, your 
Honor. But it seems to me that their rights have been some- 
what encroached upon by their own past remissness and the 
adjudication of the Court that they didn't handle this job 
properly in the past. 

THE COURT: I don't see how that goes to the 
designation of the consultant. I don't share the popular 
view that the Federal Court should get into this like a 
big elephant under the tent and be the main ring and the 
main show in all three sessions, morning, noon and night. 

I just don't think that is right. 

But aside from that, I don't see any advantage 

to plaintiffs ingoing through all these cumbersome pro- 


cedures you suggest of arbitration and all the rest. 
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I just don't see any advantage to you. 

MRS. SILVER®'“Basically, your Honor, all we are 
asking is that the data on the basis of which the selection 
will be made and the consultants will proceed be submitted 
in advance. The effect, we feel, would be that consultants 
wil) be retained with some kind of a commitment to proceed 
in a way that is open and publicized. 

We think that that would obviate a lot of trouble 
later. It will obviously be very difficult later to 


argue that the consultant was not qualified, didn't commit 


| 


terested in getting a diverse sample of opinion as required by 


the amount of highly qualified time to the job, wasn't in- 


the plan. And to move backward, trying to prove after 


the fact that they didn't perform satisfactory, would be 


both difficult and cumbersome to the Court. 
We think, your Honor, that the Court's time | 
and energy will be minimized by advance submission of | 
data and by advance selection and open selection of these | 
consultants on the basis of the proposals furnished in 
advance. 
We assume that this has been a guiding factor 
in the decision of the other Courts and the other hens in 


this circuit, that it would be desirable for this informa- 
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Just from one example, your Honor, in the 
New York Guardians case, Judge Ryan decided that he didn't nee< 
examinations in advance and the plaintiff shouldn't have 
them, and on appeal the Circuit Court said that they thought 
that was a mistake and instructed him, if it was not too 
late, to order that the examinations be furnished. 
MR. COHEN: Your Honor, —" I make an 
observation about these cases that everybody cited? | 
THE COURT: Yes. | 
MR.COHEN: The cases are being misused for 
several reasons. No. l, this was not an ~djudicated case. 
This was a consent judgment. And the procxam that has been 
designed is one that was negotiated by the parties and was 


jointly submitted to the Court with the exception of 


several relatively small reservations. 
There was never a finding other than the 
finding that went into a determination to issue a preliminary 
injunction. : 
So unlike Vulcan and Guardian and the Bridgeport 
case, this was not a case which was determined on the merits 
after a trial in which a Court is called upon to fashion 
its own remedy. 


Secondly, those cases involve single tests, the 


question of whether you are going to have a fireman's test, 
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a test for a fireman or a policeman's test. It is the 
prototype for a let of tes..‘.g that comes thereafter. 

We are dealing here with hundreds of tests and we 
are talking about a system which has to get underway, and 
that is a very different thing from a Court that is con- 
fronted with a litigated case in which it is called upon to 
fashion a remedy and the only thing confronting it is a single 
test. 

And under those circumstances a Court might well 
come to the conclusion that it may require that the test be 
presented. We have a very different set of circumstances 
here. 

If you would permit me, I would also like to 
respond to several other observations made by Mrs. Silver. 

For one thing, she talks about the fact that 
they are only asking for simple material ir connection with 
this reporting requixement, they are only asking for things 
which are going to avoid future controversies. 

That is just absolutely erroneous as a simple 
reading of the proposed reporting requirement plans will 
disclose. They are asking -~ I can remember one phrase that 
struck me as really the end in reporting requirements 
"Summaries. of Oral Reports” in connection with various kinds 


of activities. 
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They are as*ing for every action that is taken by 


the various Boards to be ts subject of a report. And 

more importint, they are not just asking that things be 
reported to them and reasonable men can differ as to what 

a level of reporting on such a matter as this might be, and 
I am sure I can say it is on one level and somebody else 
can say it is on another. But they are not just asking 


for reporting; they are asking for approval. They are 


asking for ren~’ ting and approval, either by the plaintiff or 


by the Court. 


Now, I can guarantee your Honur that based on the 


history of this case we will be in this court constantly, 
if we ever get to a reporting procedure such as they have 
developed. 

With respect to the consulting, they talk about 
a proposal. The plan is the proposal. The plan is 
what the consultants are supposed to develop. They are 
supposed to develop a prototype from the plan. If we have 
to develop a proposal, then submit it to the plaintiffs, 
we are off to Pn gine es with a negotiation thatwill be 
every bit as complicated and as lengthy and as difficult 
as the si that led to the development of this plan. We 


have got the plan. We aregoing to give it to the consult- 


ants and tell them to help us implement prototype 
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examinations and with respect to reporting we are willing to 
give information that will permit them to make the judgments 


they a2 entitled to. But they don't -- we didn't want 


» make them partners before and we do not want to make them 


partners now. 
THE COURT: All right, Mr. Cohen, may I have some 


help from you? I have never understood page 3 of the 


Rockowtiz affidavit. I put it aside several times thinking 
that I must be myoptic, and I am afraid maybe I am. But 


on page 3 of the Rockowitz affidavit, the last sentence of 


paragraph 4, he states: 


"hese reporting requirements are set forth as 


paragraph V of the plan, Exhibit A hereto." 


That's Roman numeral 5 or V, I don't know which. 
But I have never been able to be sure what he 


was talking about. 


MR. COHEN: He was talking about the portion 


s 


that begins on page 23 of the attachment to the affidavit. 


THE COURT: Ahé. 


Now, what your motion seeks to do 


is to have this Court really validate paragraph -- 5 shall we 


call it, or V? 


MR.COHEN: 5. 
THE COURT: As contained in the plan attached 


to the Rockowitz affidavit under the notice of motion, 
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correct? 


MR. COHEN: Correct. 


THE COURT: Second, this motion of the defendants 
seeks to have this Court rule that the defendants are 
entitled to select the consultants without consultation, 
arbitration or any other recommendations or formal involve- 
ment by the plaintiffs' lawyers. 

MR. COHEN: That is correct. In fact, the de- 
fendants have already designated the consultants. 

THE COURT: Right. A.I.R. and Development 
Dimensions, Inc. 

MR, COOPER Your Honor, while you have that 
paragraph 5 from page 23 in front of you, you can see 
very easily what the conflict between the parties is by 
looking at, first of all sub-paragraph A-3-B, which says 
"Promptly after examinations are held the following shall be 
given the plaintiffs' counsel." And then down in 
paragraph 5-A, "Promptly after the holding of a Step 1 
examination." 

THE COURT: Right. 


MR. COOPER: And each of the items, your 


. Honor, to be furnished there are no more burdensome 


furnished to the plaintiffs before or after the examination, 


are no more likely to be litigated if they are furnished 
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to the plaintiffs' behalf or after the examination. The 
only difference is, if those items of information are 
furnished afterward and the plaintiffs have objections to 
them, those objections will be raised to the Court and 

the Court will have to decide the validity of plaintiffs' 
objections in the context of a situation when an examination 
has already been given. If we prevail in our view the 
Court will be permitted to confront and decide any objections 
that plaintiffs have before the examination has been given 


so that parties' rights have not been prejudiced and 


sO On. ' 
THE COURT: I understand, not because of that ; 

language precisely, Professor Cooper, but because of the 

other half of the acorn here, that is, the motion 


of plaintiffs in Mrs. Silvers' affidavit I gathered that 
was it, and of course she made thatpoint in the argument. 
MR. COHEN: Your Honor, gente I just add one 
other footnote that I think gets lost Sight of sometimes? 
We have spent an enormous amount of time developing a ) 
procedure designed to insure that these exams will be | 
job rel>..1 and will meet any constitutional standard, not 
only any constitutional standard that currently exists 
but is ever going to exist. The prospect of having gone 


this far, having developed this program and then having the 
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by the consultant is a nightmare that is conjured up by the 
plaintiffs. 

MRS. SILVER: Your Honor, I just must say that 
that really misstates the case. The only way -- ; 
THE COURT: I didn’t let him finishbecause I don't 


really think it is a necessary argument. ; 

However, I must say I do side with the defend- . 
ants in regard to this business of the consultant. This 
case is quite a different case than the cases sited by 
the plaintiffs in the context of the motions of the 
defendants, which were filed some time shortly after our 
last court hearing, either the 17th, 18th, 19th or 20th, | 
and then the corresponding notice of motion of course | 
by the plaintiffs of January 6, 1975. | 

My ruling is that the Board should have the right 
to go ahead correlative to their responsibilities under 
State law to make the decision as to what consultant they 
wish to retain. 

I don't think that we can put the plaintiffs 
attorneys or the plaintiffs in the position of sharing i 
the responsibility of the Board under New York law to 


! 

{ 

do these things in the first instance. | 
Consequently the Court rules that the defendant 
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Board must have and will have the full right to make the 
choice of consultant in the first instance without any 
consultation of a formal nature or any formal advisors 
or any arbitration or any other input of a formal nature 
from plaintiffs' attorneys. 

Now, of course, in making this ruling I suppose 
there might be some practical sense, although it hasreally 
already occurred as far as I know, that as a matter of 
informal discussions between counsel and others I think 
the plaintiffs' attorneys knew in advance pretty much whom 
the Board intended to designate, isn't that about so? 

MR. COHEN: Correct. 

THE COURT: Obviously this Court sees nothing 
wrong with that, and as a practical matter, if I were 
commissioned to be your advisors, I would so advise. 

But as a matter of the Court ruling, I consider the 
plaintiffs' position to be untenable. I think that where 
we have a state or local agency which is empowered by 


state law to do certain things, the presumption should be 


that they will proceed in good faith and with regularity and 


they should have the right to go ahead unfettered without any 


Federal Court orders setting up additional advisors to 


them. 


And that's what I think the plaintiffs' position 
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would have come down to as a practical and legal matter, and 


I don't wish to be a party to that. 


| 
| 
| 
4 So I grant that branch of the defendants’ motion 
5 without reservation. | 
ik Now, in regard to the reporting business, it is | 
7 | true hat) as both Mrs. Silver and Professo. Cooper | 
| 8 pointed out, possibly in the future it could well be that | 
| | 
9 if we accept the plan which is set forth in paragraph 5 of the 
| 10 plan which is attached to the Rockowitz affidavit and | 
11 | moving papers, the plaintiffs will only receive these | 
_2 examinations after they are a matter of fact, no doubt of “| 
13 that. And it ca pneeinie that the plaintiffs' counsel | 
14 || would be constrained with respect to one or more of these 
15 examinations 01 one of the other steps to come in and seek | 
: 16 some sort of specific relief directed against a particular 
| 7 examination or part or step of an examination process. 
18 I would be foolhardy, I suppose, to deny that that is a 
19 possibility. 
20 On the other hand, I quite agree with Mr. Cohen 


the cases which have . cited by the plaintiffs in favor 


of their view of the matter at all. 
First of all, we are dealing with two defendants 


21 and the defendants when they argue this isn't really like 
| 
which are in the major business of testing, and as Mr. Cohen 
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has argued earlier and often there is not just one test which 


has never existed before which has come about by virtue of 


a litigated case where the Court thereafter,when the plaintiffs 


have prevailed, has been obliged under traditional equity 
principles to fashion its own relief. 

Now, those are two major distinctions. First 
of all, the fact is that the Court did not fashion this 
relief as such in detail. More important than that point, 
though, is that we are dealing with two defendants, the 
Board of Examiners most particularly and the Board of 
Education, which are in the business, among others, of 
testing. More than that, there are going to be a variety 
of tests for a variety of positions. 

Some of these tests will not take place for a 
long time. Some will take place immediately. 

I don't think a Federal Court of quity should 
presume or assume that institutions which are called upon 
by state and local law to give tests and who are laboring 
or will be laboring under a judgment of this Court in 


this case, will then go over the reservations and behave 


like an organization which has never given any tests at all. 


Put differently, I would rather see this court 
of equity assume that the defendants will follow the 


principles which were laid down a long time ago in this 
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litigation, patly by order of Court in the preliminary 
injunction motion, partly by an agreement thereafter between 
counsel as encompassed in all the orders and judgments, 
than just including those going back to May of last vear. 
Another reason why I refuse to grant the relief 
which the plaintiffs praysfor is that I think the defend- 
ants, though they may overstate it and may be guilty of a 
little excess rhetoric, are nevertheless close to the mark. 
Once again the plaintiffs' proposals would really make them 
a co-partner with the Board of Examiners and the Board of 
Education in administering these tests for the various job 
classifications, and I don't think that a Federal Court 
should go that far, at least at this stage in the final 
judgment. 
If it turns out later that in the implementation 
of the final judgment these presumtpions which I think 
this Court should indulge in in favor of the defendants 
are then proved wanting, why that of course may mean, 
I recognize, an expenditure of time in the litigated 
sense. But I would far rather run that risk than take 
the wholly unique step, and I believe despite Mrs. Silver's 
eloquence that this would be quite different than these 
cases which she cits, quite different indeed. Those 


cases were comparatively simplistic and did not deal with 
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defendants who theretofore had been in the business of 
testing of any significance at all. In fact, with at least 
one of them there weren't any tests, in fact I think in more 
than one. 


So I am sorry, Mrs. Silver, but I just do not 


see it.as a necessary ruling by a court of equity that we 


should ask the defendants to share every detail with you in 
the implementation of the final plan. You may some day 
to me that we will have to spend a lot of time litigating 
some failure or alleged failure on the part of the defend- 
ants. I recognize that once again. But I would rather run 
that risk than take the other route. | 
So I am going to grant the branch of the motion 
of the defendants seeking to prove their version of the 
plan which we will call paragraph 5 as they draft it in the 


attachment to the Rockowitz affidavit. | 


MRS. SILVER: Your Honor, I don't like to be 
heard to quarrel with the decision, but I would like to 
respectfully submit that we just received the papers of 
the defendant today, a day later, this morning, and I would 
request an opportunity to reargue and to submit papers -- 

THE COURT: Wait a minute. 

MRS. SILVER: Arguing those cases. 


THE COURT: Who? 


SOUTHERN DISTRICT COURT REPORTERS, U.S. COURTHOUSE 
FOLEY SQUARE, NEW YORK NY. CO ?-4580 


| 


19 


} 


jgbr 478a 


29 


MRS. SILVER: We received reply papers from 


Mr. Cohen only this morning. 

THE COURT: Oh, yes. But that is only a 
of the basic position. You mean the Cohen affidav 
today? 

MRS. SILVER: Yes. 


THE COURT: You are quite right. I jus 


rehash 


it of 


t received 


it myself and so did you. But, frankly, he just resonds 


to some of your arguments. But basically it is a 


as I see it, quite clearly of their original posit 


MRS. SILVER: Your Honor, we feel very 
strongly -- 


THE COURT: Of course you do. 


rehash, 


ion. 


MRS. SILVER: -- that the issue we have raised 


here is very important and is very important to th 
of this case. 

THE COURT: I don't deny it. 

MRS. SILVER: I would respectfully ask 
tunity to reargue. 

THE COURT: I don't know what there is 
argue, because I have here your papers, which are 
stantial, I have your memorandum of law. I don't 
what else you could say. 


MRS. SILVER: Well, your Honor -- 
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THE COURT: Except to say you disagree with me, 
which I accept and respect. 

MRS. SILVER: Of course. One of the things 
that troubles me is that perhaps the welter of words does 
not Sharply enough focus on the facts. | 

THE COURT: Look, Mrs. Silver, you are far too 
nitce and far too able for me to deny. And second of all, 
whatever my thoughts are, Rule 9 of the General Rules of 
this court certainly permits reargument. But I would submit 
to you most earnestly, please, if you wish to do this, make 
it succinct and cover only what you think that I have over- 
looked. ' 

That's what the rule requires in any event. 
But I would particularly underscore it here because, you 


know, we have been talking about this and whittling about it 
| 


| 
| 
| 


for months. True, it just formally finally came to a head, 
because I've been complaining so that nobody did 
anything to bring it to a head. But that doesn't mean that 
we have been going off in total ignorance of the issue. 
We have known about the consultant issue since last May at 
least. We have known about the reporting issue. 

You, Mrs. DuBois in particular have told me, | 
perhaps informally I admit, Mr. Cohen has mentioned certain , 


eo 
things at other hearings. I've understood thi-s. 
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MRS. SILVER: I do not discern the distinction 
which has been raised between this case an other cases 
involving testing systems, cases against Civil Service 
Commissions which are in the business of testing -- 

THE COURT: A, but this was no test theretofore 
for the kind of thing which was at issue in the case, and 
also, although I must say I don't accept it as being quite 
as important as perhaps Mr. Cohen does, this was a situation, 
eur case unlike those cases, where basically to your 
everlesting credit and the attorneys for the defendants’ 
credit credit you worked out the so-called final plan with- 
out those coming to an agreement on these two points. 

Also I might add, which I haven't stated, we 
have really been living sinfully, I suspect in the eyes 
of the last panel of the Court of Appeals which reviewed 
this case, under the temporary or preliminary plan. ' 


Now, with some possible small halting moments, minute 


variations, we seem to have lived tolerably well. 

You and Mrs. DuBois in particular have pointed 
out that the Board hasn't been as timely as we asked them 
to be. That is the fact. But, passing all of that 


problem, we have come around tolerably well to a livable | 
system. | 


So again, it isn't quite like those cases you 
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cite. I mean it seems to markedly differ, in fact, that 
I don't know quite why you push them. 
MRS. SILVER: Well, I think that ..ere is some 
confusion, your Honor, about the meaning and significance of 


the plan -- 


THE COURT: I can't deny the courts have said in 


' 


these civil rights cases where examinations are involved that 


all parties or the lawyers should see the proposed examinations 


in advance. Of course they have, and quite rightly. 
I don't quarrel with any of those opinions. And it is not 
just in this circuit and it is not just in recent times. 
It goes back to at least 1959 or '60. 

But I regard this as a somewhat different case 
to put it midily. 

MRS. SILVER: What we would like to do, your 


Honor, is to focus attention on these three prototypical 


| 


exams and urge that the specific information, call it detailed 


or not detailed, that the defendants propose in their Part 5 
to submit with respect to those examinations be submitted 
in advance of the administration of those examinations 


rather than later. 
THE COURT: You made that abundantly clear in your 


papers, and if you didn't, and that you did today and so 


did Professor Cooper. 
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I understand that and I have thought about it. 

Mr. Patterson and I discussed it most recently 
today, and we can see your argument, well, maybe you are 
right, maybe there will be more litigation, maybe there 
will be more time we could have in an isolated instance 
or maybe several instances we could have saved time. 

But I do not see how I as an agent of this court 
can presume that at this late stage in this ancient 
lawsuit that the defendan*s are going to go off the 
reservation on all of these examinations. 

MRS. SILVER: Professor Cooper's suggestion 
that possibly if the burden were on us to come in and object, 
but we nevertheless got the information sufficiently 
in advance so that the burden would be exerciseable 
that would be both rair to plaintiffs and conducive to 
expeditious resolution of these problems. 

THE COURT: Well, there is one thing I would 
say to you ari to Professor Cooper. iz ft were the 
defendants in this case, I would, as a practical accommo- 
dation, try to get this information to you in advance. But 
to me that is saying a very, very different thing than 
requiring this by Court order. It might save a lot of 
time and fussing if this were done. I agree. 


MRS. SILVER: I think that everything that has 


SOUTHERN DISTRICT COURT REPORTERS, U.S. ¢ OURTHOUSE 
FOLEY SQUARE, MEW YORK, N.Y. CO ?-4580- : 


a ££ & B&B 


jgbr 483a 34 


happened in this case proves that the defendants cannot as a 
public body furnish to us in advance information which we 
have asked the Court to order them to furnish and the Court 
has said they need not furnish. 

It is politically, socially practically impossible 
for them to do that. And I think that all our repeated ! 
appearances before this Court establish that that is so. 
And that's what Mr. Cohen is saying when he says in effect 
that they will never agree to anything. j 

THE COURT: Well, - dente think the latter is 
quite true. The two things you didn't agree on are the 
things we are discussing today, and really in a very large 
sense, and I say this to your credit as well as to the 
defense counsel, you are responsible for that happy fact. | 
But now we come down to these differences, which have delayed 
us now for at least six or seven months, and I say that in 
trying to balance the equities as best I can the rulirg should 
adhere in favor of the defendant. | 

What I suggest to you, if you make your motion : 
to reargue, you can do it ina letter or in a simple 
affidavit or however you prefer, but you put your finger on 
the problem and Professor Cooper did too. You want 


these papers in advance. That's the crux. 
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THE COURT: You have made yourself abundantly 
clear. 

My view of the matter is that that would only 
breed more problems, more confusion, more delay, more 
arguments, and I recognize that the burden is on you really 
to show that they are wrong. It seems to me both under 
state and federal law some presumption of regularity still 
must attach even notwithstan<-ing this litigation, and that's 
why I summarized what I summarized and what I said a moment 
ago. 

True, the defendants may have erred and you 
proved it. But, on the other hand, we have been living 
under this preliminary system. The City of New York 
rarely does anything on time, in my experience, around here 
at least. I know that. But in their own bumbling way 
I think they might do all right here, and I am trying to 
give them a chance. 

You think about it, and I would welcome any re- 
argument position you want to take on that issue which is 
fundamental, as I understand it, or indeed something 
less than fundamental. 

MR. REBELL: If I could just take a moment. 

I am wondering what the implication of your granting 


defendants’ motion in this matter is. Does that take it 
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to mean that at this point the entire plan with the 


recommendations of defendants for Part 5 on consultants is 


going to be adopted by the Court or is there going to be 


a further hearing or class action hearing or any other | 


opportunity for additional commentary on the plan as a 


whole? 


| 
| 
THE COURT: Well, now, wait a minute, Mr. Rebell. | 
Pirst of all, I think Mr. Cohen would say this resolves the | 
final plan pretty much. | 
Right? | 


MR. COHEN: Correct. | 


[page 39] 


THE COURT: Now, Mr. Cohen, I am going to just. | 


write a little memorandum endorsement granting the defendants' 


| 
motion, denying plaintiffs' motion so that Mrs. Silvercan 


| 
get in her motion to rearguc if she wishes, and I think you 
do. 

MRS. SILVER: Yes, your Honor. 

THE COURT: All right. 


| 
| 
i 
1 
| 
| 
i 
j 
| 
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[Transcript ends on page 42] 
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Memoranda Decisions of Judge Tyler, dated January 17, 

1975, endorsed on the motions of plaintiffs (served 

January 2, 1975) and the Board of Examiners (dated 
December 20, 1974) 
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The preceding document is barely legible. 
We have read the original, and below the following is 
a true typed copy of Judge Tyler's Memorandum Decision. 


This typed copy is submitted for purposes of clarity. 


ear 
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January 14, 1975 


The within applications are denied 
for reasons dictated to the court reporter 
at the conclusion of the hearing therein 
today. 


It is so ordered. 


S/ H.R. TYLER, Jr. 
U.S. District Judge 
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Letter dated January 28, 1975 from Elizabeth 
to Judge Tyler. 
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January 28, 1975 


The Honorable Harold R. Tyler, Jr. 
United States District Judge 

for the Southern District of New York 
United States Courthouse 
Foley Square 
New York, New York 10007 
Re: Chance v. Board of Examiners 

40 Civ. 4141 


Dear Judge Tyler: 


This letter is submitted pursuant to the Court's 
Suggestion at the January 14 hearing, as plaintiffs' 
motion for reargument of the Court's ruling on the 
scope cf "reporting and monitoring requirements" to 
be included in a final order. Plaintiffs respectfully 
request that the Court grant this motion and schedule 
reargument on that issue at its earliest convenience. 


Preliminarily, we must request that the Court 
adjourn tne date for settlement of defendants' proposed 
final order (served on plaintiffs without any prior 
discussion or forewarning last Friday afternoon) until 
such time as the Court resolves the issues raised by 
the present motion for reargument. In view of the 
Court's clear indication at the hearing that it would 
entertain such a motion before the submission of pro- 
posed counter-orders, the defendants' very submission 
of their proposed order at this time seems highly in- 
appropriate. In any event, however, the settlement 
date clearly should be postponed to permit submission 
of orders reflecting the outcome of the motion.* 


oo 

In view of our request to postpone settlement, we do 
net kere discuss the problems raised by the defendants' 
proposed final order. We note, however, that they are 
not confined to the issue of adequate reporting. Among 
other things, (1) the proposal fails completely to re- 
solve the problem posed by the continued existence of a 
Preliminary Injunction against the Board of Education 
(continued next page) 
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Plaintiffs are not submitting a proposed order herewith 
partly in the belief that reporting provisions might better be 
included directly in a final order than buried, as both 
plaintiffs' and defendants' proposed provisions were, in Part 
V of the "Plan***for Licensing Supervisors" (hereinafter, 
the "Plan") which each submitted for approval to the Court in 
the January 14 motions. (Cf. Ex. A to Aff. Murray Rockowitz, 
December 20, 1974; Ex. A to Aff. Jeanne R. Silver, January 3, 
1975). Amother reason is our reluctance to encourage a 
repetition of what occurred in the prior written and oral | 
arguments, when defendants obscured the gross deficiencies in 
their proposed reporting requirements by attacking the procedures 
and alleged unnecessary "detail" in plaintiffs' proposal. 


The Court's comments at the hearing suggest that defendants 
succeeded in conveying a mistaken impression of both parties' 
position. Contrary to the statement of defendants' counsel, 
their proposal did not afford anything like a "reasonable" 
amount of data looking toward determination of whether they 
complied with the Court's Order or the Plan. Moreover, by 
virtue of its omissions, their proposal arguably would have 
authorized the withholding of much data crucial to such 
determination. 


. In a striking example, defendants' proposal omitted to pro- 
vide for production of ethnic and racial data on the results of 
almost all tests. There was no conceivable justification for 
this omission in a lawsuit which successfully challenged the 
constitutionality of 50 examinations. As further discussed 
below, the virtual certainty that defendants' would fail to 
provide such information absent a court requirement guaranteed 
a plethora of new lawsuits encumbered by the same expensive and 
time-consuming efforts to develop and procure proof which pre- 
ceded the injunction in this case. 


Plaintiffs' can hardly be charged with seeking a "partner- 
ship" relationship with defendants in developing new examinations 
when they urge that the Court should require racial data on all 
tests and other information equally pertinent to the issue of 
compliance to be produced for their inspection. As we have from 
the beginning, we are simply asking for assurance that informa- 
tion sufficient in scope to permit such determination be fur- 
nished to plaintiffs regulariy and at appropriate times so that 
such determination may be made promptly, routinely and without 
the necessity for litigation after destruction of records may 
have made the effort fruitless. 


from preceding page) 

Scr Plaintiffs' Notice of Motion, January 3, 1975, para. 2), 
(2) improperly strikes paras. II A, 1X and X of the original 
Orders of July 12, 1973 and G) persists in the fiction that 
the "Plan" it would incorporate reflects the consent of the 
parties, despite plaintiffs' long-standing position that our 
assent was subject to agreement on reporting provisions and 
consulting firms. 


a 
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To keep this issue in focus, we are avoiding discussion in 
tliis motion of the precise time frame of reporting procedures, 
tr method for resolving disputes on compliance issues or other 
acninistrative matters. Such problems can be resolved in the 
settlement of an order once the scope of reporting provisions 
is defined. Our purpose in this letter is to demonstrate the 
gross deficiencies in the defendants' proposal and urge that 
the Court require at least the following four basic modifications 
in their plan. 


I. The Requirements Should Mandate Submission of 
Information on the LEVERS and Non-Discriminatoriness 

of Step 2 Evaluation Procedures 

A particularly serious omission from the defendants' 
proposed "Reporting Requirements" is the failure to require 
submission of any data whatsoever on Step 2 evaluation pro- 
cedures for any positions. Defendants would have no duty 
to submit information regarding the development, substance, 
validation or outcome of this stage of the two-part 
licensing system, either before or after such evaluations 
were held.* 


The "Plan****for Licensing Supervisors" which the Court 
has accepted on defendants' motion as a basis for develop- 
ing new examination procedures makes the Step 2 evaluation 
a vital part of the new non-discriminatory licensing pro- 
cess. Since success on the evaluation is a condition to 
the issuance of permanent licenscs, their job relatedness 
and lack of bias are crucial to the new licensing system's 
constitutionality. Thus, unless defendants are required 
to furnish validation and pass-fail data on Step 2, plain- 
tiffs will have no way of determining whether the licensing 
procedures developed under the Plan avoid the deficiencies 
of the old system or simply reinstitute the discriminatory 
and non-job-related patterns invalidated by the Court. 


II. The Requirements Should Mandate Submission At Least of 


Ethnic and Racial Data on Bot Steps of All Examinations 


Except with respect to the so-called "prototype" 
examinations, defendants' Reporting Requirements absolve 


It cannot be maintained that the provision in Part V 4 for fur- 
nishing documents on "notice," which in any event pertains only to 
prototype examinations, supplies this omission. Having excluded 
such data from the scope of defined requirements, defendants can 
hardly be counted on to decide it is "relevant" later and furnish 
it voluntarily, particulariy should the results turn out to evi- 
dence discrimination. In view of their present disparagement of 
such information, it is indeed doubtful that defendants will even 
develop or retain such information. 
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them from submitting any data at all. Thus, if their 
requirements become the sole reporting provisions in a 
final orcer, data related to only the first parts (sce 
discussion, supra) of three examinations furnished after 
they are administered,* will be the only information 
available to plaintiffs for assessing the constitutionality 
of a sweeping new system covering 50 or more tests. 


There is no basis for such an approach in the history 
of this litigation, where the Court struck down the 
defendants’ licensing system on the basis of tests for 
all 50 positions and issued its injunction against all of 
them. Its most serious aspect is that even racial and 
ethnic data on pass-fail rates would not have to be 
revealed. 


We know from experience in this very case that defend- 
ants oppose not only the submission but also the collection 
and preservatior. of information on the race and ethnic 
group of peopJ< who take their tests. They made this more 
than clear in the early stages of the litigation when they 
claimed on the basis of self-serving data that their old 
examinations had no discriminatory impact and then turned 
out to have no information establishing the truth or 
falsity of the claim.** It was only after an expensive and 
difficult survey entailing many disputes which this Court 
was forced to resolve, that data was obtained establishing 
the discriminatory character of the examina’ ‘ons. **%* 


Not surprisingly in view of that history, the Final 
Judgment and underlying settlement followed usual practice 
in requiring (Para. VI) that data "showing the comparative 


* 

Even if the Court grants our request, infra, for advance sub- 
mission of validation data on prototypes, and for information on 
Step 2 evaluations (supra), there is no guarantee that such infor- 
mation will be available before the administration of other exam- 
inations, since the Plan does not require the completion of any 
steps of the prototypical examinations other than job analyses 
before other examinations are initiated. 


** Evidence that defendants still adhere to this position is 
suggested by their continuing failure to have submitted ethnic data 
on the so-called "III B' examinations. Although the written por- 
tions of those examinations were administered before the injunction 
herein, their completion entailed oral interviews in which defend- 
ants could presumably have applied routine procedures for collecting 
such data, if they had such routines. 


ne" survey is discussed in Judge Mansfield's original opinion 
at 330 F. Supp. 203, 209. 
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performance of blacks, Puerto Ricans and whites" be collected, 
maintained and furnished to plaintiffs and the Court before 
the issuance of licenses based on the interim evaluation pro- 
cedures. Plaintiffs submit that it would be contrary to 
sound principles of law and judicial administration to re- 
quire anything less with respect to the pass-fail results 

of Step ] ad Step 2 tests administered under the new systeu, 
at least ut til data regarding a reasonable number of them has 
afforded reasonable assurance that continued implementation 
of the system will not repeat the pervasive pattern of de 
facto discrimination found by Judge Mansfield. Chance Vv. 
Board of Examiners, 330 F. Supp. 203, 209-14 (S.D.N.Y. 1971), 
atta 450 F.2d 11G/ (24 Cir, 1972). 


ili. The Requirements Should Provide for Submission of 
Content Validation Data in Adv ice of Administering 


Step [ and Step 2 Prototypical Examinations 


We argued before the Court and in our papers the 
rationale for requiring as other Courts consistently have, 
that at least the apparent validity of the prototypical 
new tests be established before they are administered. In 
view of the decisions cited,* the provisions of Para. X of 
the Final Judgment and the strong practical considerations 
supporting this request, we submit that its rejection would 
be improvident. 


We cannot conceive of a basis for distinguishing other 
cases in which Courts have granted similar relief. The 
Court here would appear to have been misled by the defend- 
ants' repeated emphasis on their "consent" to the Final 
Order and the alleged consent of all parties to the "Plan**** 
for Developing a New Licensing System.** Defendants' counsel 


oc 


See Guardians Assn. of NYC Police Dept. v. Civil Service Com. 
of NYC, 6 E.P.D. 8969 (2d Cir. 1973); Castro v. Beecher, 459, F.2d 
fo (1st Cir. 1972), order on remand, 5 E.F.D. % D. Mass. 
1973); Vulcan Society v. Civil Service Comm. of NYC, 6 E.P.D. 48974 
(S.0.0.7, 2974), aff'd, 490 F.2d 387 (2d Cir. 1973); Brid eport 
Guardians Assn. v. Bridgeport Civil Scrv. Comm., 354 F. Supp. 778 


D. Conn), aff'd F. Cir. ; Carter v. Gallagher, 
4 E.P.D. 47853 (D. Minn. 1972). ana 


* 


si Significantly, in all versions submitted to the Court, this 
document is captioned ''Plan Proposed By the Board of Examiners, 
Board of Education ani the Chancellor, for Licensing Supervisors in 
the New York City School System." This reflects two salient under- 
lying factors: (1) the Plan is not a proposal of plaintiffs to 
which the defendants adhere but an outline drafted initially by 
defendants and (2) defendants' failure to agree with plaintiffs on 
reporting requirements and consulting firms abrogated essential 
preconditions to plaintiffs' concurrence. 
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spoke on the argument and in their papers as if this entire 
proceeding had been resolved by mutual assent to a series 
of new programs equally <Ongenial to the parties. In fact 
the proceeding was hotly .itigated and Judge Mansfield's 
original decision was based on what both Courts characterized 
as "extensive evidence". The defendants willingness to 
regotiate followed only upon extensive findings, conclusions 
and repeate.’ iterations by lower and higher courts that of 
a "strong likelihood that plaintiffs would prevail" on the 
merits. See Chance v. Board of Examiners, supra, 458 F.2d 
at 1178. As recently stated y Judge Frankel in a related 
context, to treat such consent under such pressures as 
absolving defendants from otherwise no- obligations of 
losing parties in a constitutional case . «ld be an 
invitation to "intransigent litigation" by plaintiffs. 
ASPIRA of New York v. Board of Education (S.D.N.¥. 72 Civ. 

s dan. 2, 1975, p. ‘ 


Defendants' "consent" to the Plan for the permanent new 
licensing system obviously was generated by the same 
pressures as their assent to the settlement. Were there 
any doubt of tis, it would be set at rest by their blatant 
refusal to neg. ciate adequate requirements for reporting on 
their compliance.* 


Finally, the Court's indication that the defendant 
Boards were somehow differentiated from the Civil Service 
Commission in comparable cases makes no sense whatsoever. 
Like the Board of Examiners, the civil service commissions' 
are in the business of developing tests and they do so not 
just for one but virtually for all city agencies. 


Against the arguments of precedent and common sense, 
defendants' only argument for withholding test development 
data until after administration of tests has erected 
formidable barriers to their revision, is the alleged 
“elay entailed in such procedure. ‘his contention is 
belied completely by their own proposal to submit such 
data regarding Step 1 prototype examinations "promptly 
after examinations are held.' {Part Vv 3b), 5). If the 
a | data can be made available immediately after the examinations 
are given, it can clearly be made available before and may 
just as well be furnished at such time. 


Plaintiffs have nevertheless acknowledged the practical 
burdens which might be imposed by advance submission of 
ag test validation data by asking that such data be furnished 


“i In itself, of course, the Plan is no assurance that the 
examinations developed will be constitutional. (Aff. Richard 
Barrett, annexed to Aff. J, R. Silver Jan. a, 1975). 


‘le Honorable Harold R. tyler, Jr. 
January 28, 1975 Page seven 


497a 


in advance only for each step of the three prototype 
examinations. Plaintiffs submit that this limitation of 
our request is a more than reasonable compromise of plain- 
tiffs' right to be assured cf the validity of defendants! 
approach to test development before administration of 
tests to hundreds of people imposes obstacles to their 
revision. 


IV. The Requirements Should Include Record-Retention 


Provisions, Durational Limit and Provisions for 


Furnishing Certain Types of Information Not Directly 


Related to Test Development 
SESS £O test vevelopment 


One additional important problem, which epitomizes 
the perfunctory character of defendants' entire reporting 
proposal, is the omission of any provisions regarding 
duration, record-keeping or other regular reporting on 
their obligations under the Plan. 


Virtually "boilerplate" in cases of this kind, 
record-keeping provisions can certainly not be omitted 
in this case without jeopardizing the continued existence 
of data necessary to determine compliance with the Court's 
decree. The vague and incomplete character of defendants! 
proposals makes such a provision particularly necessa:y 
since they would otherwise afford little basis for assuring 
the preservation of racial and ethnic data, general infor- 
mation on test development and information on compliance 
with defendants’ other obligations under the Plan. 


The Plan in fact imposes on defendants a number of 
such other obligations not specifically related to the 
development of tests but very material to the creation and 
maintenance of a non-discriminatory licensing System. Thus, 
the Examiners are required to improve the training and 
racial balance* of their staff who would administer 
tests and evaluations, (Part III F). In order to open up the sys- 
tem to more members of minority groups, they are required to make 
specific efforts to increase the frequency with whic 
tests are administered (Part III C) and cut down the number 
of different tests for differeni. }6hs (Part i, 2;.3). the 
Board of Education is required to contribute to the latter 
process by seeking to ascertain common elements in different 
jobs and combining job titles susceptible of assessment in 
the same tests. 


Judge Mansfield found that there was a ""serious and sub- 
stantial question’ as to whether discrimination against Blacks 
and Puerto Ricans is not being unconsciously practiced by white 
interview examiners." 


“he Honorable Harold R. Tyler, Jr. 
January 28, 1975 Page eight 


498a 


It would be completely unreasonable to exempt the 
defendants from an obligation to report on their compliance 
with these important duties, since in the absence of such 
reporting it is hard to imagine how anyone could determine 
whether they had complied or not. We also submit that 
time schedules for furnishing such data must be established 
if there is to be any chance of avoiding the defendants' 
repeated delays and appeals to the Court which have 
characterized performance of obligations under the interim 

icensing system. Those problems have arisen in the face 
of mandatory deadlines; certainly the situation would be 
worse in their absence. 


. 


CONCLUSION 


Plaintiffs submit that the above discussion demonstrates 
the complete insufficiency of defendants' proposed reporting 
requirements. We therefore respectfully request that the Court 
grant our motion for reargument of its July 14 ruling endorsing 
those proposals for inclusion in the final order, and after 
appropriate further proceedings, issue a new decision requiring 
settlement of an order containing at least the additional 
requirements set forth above. 


Sincerely, 


ELLE Lilia 
ELIZABETH B. DuBOIS 


(Legal Action Center of the 
City of New York, Inc 

271 Madison Avenue 

New York, New York 10016 

(212) 679-6502 


ee 


JEANNE R. SILVER 
20 West 40 Street 
New York, New York 10018 


cc: Leonard Bernikow, Esq. 
Saul Z. Cohen, Esq. 


Memorandum Decision and Order of Judge 
Tyler, dated February 4, 1975 
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The preceding document is barely legible. 
We have read the original, and the following is a true 


typed copy of Judge Tyler's Memorandum Decision. This 


typed copy is submitted for purposes of clarity. 
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RE: Boston M. Chance et al. v. The Board 
of Examiners et al., 70 Civ. 4141 HRT 


On January 14, 1975, after a hearing, this court granted 
in substantial part the motion of defendants to settle a 
plenary examinations plan for the selection and licensing 
of supervisors in the City school system. Thereafter, 
with the permission of the court, plaintiffs' counsel sub- 
mitted an application by Letter to rehear the terms 
and conditions of the plan. 

Unfortunately, the motion for reargument submitted by 
plaintiffs does not specify precisely how they would 
like the order to read. Their letter leads me to believe, 
however, that the plaintiffs may have some specific ideas 
worthy of consideration. Accordingly, the motion for re- 
argument filed by plaintiffs is granted, and plaintiffs' 
counsel are directed to serve and file a proposed 
counter order with the changes, or emendations, and 
amendments which they feel are appropriate. This counter 
order shold be in the classic form with as much speci- 
ficity regarding reporting as possible - particularly 
with respect to the types of data to be collected and 


maintained, what should be reported to plaintiffs and 


502a 


others, when reports should be made, and how plaintiffs 
should proceed if they determine, on the basis of the 
reports, that the defendants are acting inappropriately. 
In the meantime, this court will hold in abeyance the 
supplement of the proposed order, which was apparently 
filed by defense counsel in the Clerk's Office on 
January 14th but not received by the undersigned until 
January 31, 1975. 

Plaintiffs' proposed counter order should be 
served and filed no later than February 11, 1975. 


It is so ordered. 


Dated: February 4, 1975 


s/ H.R. TYLER, IR. 
U.6.0.0 
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Letter dated March 10, 1975, from Leonard 
Bernixow to Judge Tyler 


X 


ae 
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tion. Harold R. Tyler, ur. 
United States Distsrict Court 
Scuthern District of Ne 

United States Courthou 
Foley Scuare 

lew York, Mew York 11201 


Re: Chance v. Board of Fxaniners 
70 Civ. 41461 y - 
Dear Judge Tyler: 
Plaintiffs. by their motion of January 3, 1975 for modifi- 
cation of the final judgment, sought to have the consent 
judgment of July 12, 1973 entered against the Board of 
“Education. The theor y behind plaintiffs’ motion is that 


the Board of Education has not seught a trial of the 
merits in this proceeding. ft should b2 noted that the 
burden is on the plaintiffs to bring an issue to trial 
and they have not sought to do so. Nonetheless the 

Board of Fducation would consent to the entry of the 
consent judgment previously entered against the Board of 
Examiners on July 12, 1973. 


Tne Board of Education, however, opposes laintiffs’ 
7 
proposec counter order, noticed for settlenient for Febru- 


ary 13, 1975. ‘ 


Respectfully yours, 


o tf 
di 
2) 
se 
™ 
G . 
cd : 
% 

% 
= 
9 


2 y 
ssistant Corporation Counsel 


ce: Jeanne F. Silver, Psc. 
Saul 2. Conen, Fac. 


Order of Judge Tyler (plus exhibit), dated 
March 25, 1975 
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UNITED STATES DISTRICT COURT 


‘SOUTHERN DISTRICT OF NEW 


Oe 


_BOSTON M, CHANCE 
LOUIS C, MERCAIXO), ot al., 


’ YORK 


ee 


Plaintiffs, 


-apainst- 


THE BOARD OF EXAMINERS AND ‘THE 
BOARD OF EDUCATION OF THE CIT) 


OF NEW YORK, «t al., 


Defendants, 


Oe ee 


MAR 25 1975 
SD. oF Nu 


ORDER MODIFYING 
FINAL. JUDGMENT 
AND ORDER 


70 Civ. 4141 HRT 


WHEREAS, on July 12, 1973, this court entered a Final Judgment 


herein ayainst defendant Board of Mxaminers, its members, and defendant 


e 


Chancellor of the City School istrict of the City of New York based upon a 


Stipulation of Settlement with the plaintiffs, approved by the court; and 


WHEREAS, defendant Board of Education, 


its rnembers, and the 


Deputy Superintendent of Schools did not consent to the said Stipulation of 


Settlement, and plaintiffs moved for a default judgment or, in the alternative, 


an order modilyiny the outstan 


defendants, and the court on July | 


ding Vrelinvinary Injunction zpainst all 


1 1974, 


issued an order apainst them 


modifying the Prelitoinary Ini tion to require that they adhere to the terms 


of the aforesaid Pins! Judeniemt wainst the other defendants pending the 


ection, + 


determination of tiis 


id 


Order authorized defendants (9 administer an interim examination system 


' 


I 
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| 
| WHEREAS, paragraphs III and VI of the July 12, 1973 Judgment and 
pending development of a Plan for a permanent system for the sclection and 


licensing of supervisors in the New York Gity School System, and para- 


graphs. .. X provided for modification of said Judpyment and Order to 


permit the implementation of su ha Plan, and the administration of plenary 
examinations for supervisors; and 

WIIEREFAS, all oarties herein agreed upon a Plan for such plenary 
examinations, except that they did not ayree on the method for choosing t’ e 
consultants tu be used by defendants under the Plan and they did not agree 
upon a reporting provision, a id they subinitted the Plan to this court on 
May 24, 1974; ane 

WHEREAS, all the defendants -aoved this court on December 20, 1974, 
for an order modifying the aforesaid Final Judgment and Preliminary 
Injunction to permit the developroent and implementation by defendants of 


a permanent new licensing system in ae ordance with the aforesaid Plan 


cee a pear 


(with certain modilications), ane : 

WIIEREAS, the plaintiffs moved ibe court on January 3, 1975, to 
issuc an order permitting the evelopment by defenders of a permanent new 
licensiny system in accordance with the Plan (with maodiiic os proposed 
by their counsel), nad, farther, 10 txsue.a hinal Jud sme avainst the 


defendants Poard of Mducation, its members and the Deputy Superintendent 


of Schools; and 


= 


emmeneerumaatneiianernanen tan. ett OL ECL LALO LET, 
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WHEREAS, the court has reccived a letter dated March 10, 1975, 


from the Board of Education indicating its consent to the entry 
3 
of the Final Judgment of July 12, 1973, previously entered against tne Board 


of Examiners; and 


WHER®EA, this court consi:iered the motion papers submitted by 


defendants, the motion papers and memorandum of iaw submitted by 
plaintiffs, and the reply affidavits submitted by defendants; held a hearing 
on January 14, 1974, at which time it heard argument from counsel for 
defendants and counsel for plaintiffs; and, being fully advised, rendered its 
oral decision on January I4, 1975; and 

WHEREAS, this court has considerd plaintiffs' letter of January 28, 
195, as a motion for reargument of the decision of Tanuary 14, 1975, and 
has determined to prant that motion in part, having also considered defendant 
Board of Examiners! memorandum opposing plaintiffs! reargument motion 
and proposed counter-order; and 

NOW, THEREIORE, the court having received orders and counter- 
orders -clevant to these maticrs submitted in connection with the parties' 
rnoztions and prio: proceedings herein. it )> hereby ORDERED that: 
I, Defendants’ aforesaid motion is hereby pranted as hereinafter modified 
and is in all other respects denied. 
U. Flaintiffs' aforesai:! motions are hereby granted, as hereinafter indicated 
and arc it al! other respects denied, 
Il, This court's Final Judgement of July 12, 1973, against the ce 
Board of Examiners, its hens and the Chancellor of the City School 


System, and its Order of the same date against the defendants Board cf 
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Education, its members and the Deputy Superintendent of Schools modifying 
the Preliminary Injunction theretofore issued, are modified as hereinafter 
provided, 

IV, As of the effective date of this Order, the provisions of the Final 
Iudgment of July 12, 1875, as modified, shall awely fully to all of the 
defendants, and ali the defendants shall be bond thereby. 

V. Except to the estent mneonsistent herewith, the provisions of the afore- 


gaid Final Judgment shall continue in full force and effect 18 apainst all of 


en cece ences eat EA OL OIE | CONN 


the defendants. 


Vl, The Plan fora compreheusive system of plenary examinations for 


i supervisors in the New York City School System which was annexed as an 


exhibit to the affidavit of Murray Rackowity, sworn to December 20, 1974, : 
and a copy of which is annexed hereto and made a part bereol (the "Plan 1, 

is approved as herein modified, and, notwithstanding any other provision in 24 
the July 12, 1973, Judsment and Order, defendants are permitted and 
authorized ta develop examinations for supervisory positions and thereafter 


examinations, to pronmirate clivilde lists and to issue lloeenses based upon 


to administer sad conduet sie hoxaminations, {oO process and prade such- 
i : - 
Vil bora pericd conuneneing with the date of this Order and ending two | 


years after permanent licenses have been promulpated for all f the positions 


such examinations, «all in aecerdance with that Plan. 
| defined as "prototypical in Que anne cd Vlun, deféaianis shalt comply vith 


the following provisions tor collecting, maintainine and furnishing data to 


| 
| 
| 
| 
| 
| 


plaintiffs’ connsed: 
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A, Defendants shall collect and maintain, or, if defendants prefer, 


turn over to plaintiffs the following data: 


l. Jeb analyses prepared for all supervisory positions, with 
? 
underlying data and any interim reports peneratcd and used 


in their preparation. 


2. Step | tests and full dese riptions of all Step 2 evaluation 


procedures for all supervisory positions, with scoring shects, 


assessment profiles and manuals on use of results. 


3. All validation studies and other data including but not 


limited to documents showing the relationship of test elements 


and procedures to behavier clements in job analyses, relevant 


to determining the validity and job-relatedness of all Step! 
examinations and Step 2 evaluation procedures. 

4, Full information on the ethnic and racial character (black, 
Puerto Rican or Latin American descent or origin, white) and 


on the qualifications of examination assistarts or other 


personnel who administer the step l tests and Step 2 evaluations,' 


respectively, for cach supervisory position, 

5, Analyses with respect to cach Step test and Step 2 
evaluation for each position of the number of applicants for 
each, their race/ethnicity (ick, Puerto Rican or Latin 
American descent or orisin, white); and the nuniber of 
applicants actually pirtys ipating inveach, their race fethnicits, 


and the pass -fail results of each, spec ifieatly showing the 


comparative performance af blacks, persons of Puerto Kican 


| 
| 
| 
| 


or Latin American Apion or origin and whites. 
6. All other data, studies, analyses and reports relevant to 
the development and im ptementation of the Plan and generated 
in the course of development or implementation, 

B. As each job analysis for one of the three apotvcionl positions 


is completed, defendants shall permit plaintiffs access to it and to all 


reports and other information furnished by the consultant to defendants 


bearing on the procedures followed in conducting it and the soundness 


of its conclusions. 


C. Defendants shall not announce or conduct any Step 1 test or Step 2 
evaluation for any of the three prototypical positions on any date less 


than two weeks after plaintiffs have been afforded all the information 


and opportunities provided for in pa ragraph X of the July 12, 1973 
Defendants shall notify plaintiffs of their intentior 


Final Judyment. 


to administer tests and evaluations for other than prototypical positions 


at least two weeks before they are conducted 
D. All material to be collected and maintained pursuant to this 
' counsel for inspection 


paragraph shall be made available to plaintiffs 


as svon as is practicable after its collection but, in any event, within 


three weeks after its collection, 


E. Inthe exercise of its continuine jurisdiction pursuant to Parayraph 
| rap 


XIV of the Final Judgment of July 12, 1973 herein the court shall 
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entertain appropriate applications for «attorneys! fees and such Orders 


as may be necessary to protect the privacy of individuals or the 


| ' 
| confidentiality of test questions or of hear challenges as to the 
i constitutionalily of any new test which ts implemented, 


¥ 
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Dated: Now York, New York 
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Plan Proposed by the Hoard of Examiners, 
Board of Education and the Chincellor, 
for Licensing Supervisors in the New 
York City School System. 


. 5l3a 
Introduction 


This proposal outlines a procecure for the develop- 
ment of examinations by the Board of E.:.2z1tners te fulfill 
ius statutory responsibility to provide examinations for the 
“Vieensing of supervisors on the basis of "merit and fitness" 
through the use of “open qualifying" examinations. To arvieve 
this objective the proposal provides fer: 

“(1) Job analyses of all supervisory positions; 
(2) Development of job-related examinations which 

shall consist of the following essential steps - - 
Step 1 shall consist of a comprehensive assenurcnt program, 
whose results shall be scored and repo.ted in a manner more 
useful to the new Community School Board type of adm{pistra- 
tion and which shall result in the provisional licensing o* 
all eligible applicants except those who fail to meet levels 


of minimum acceptable performance. 


Step ¢ shall cansist of an on-the-job performance evaluation 
of persons who have served with provisionai licenses, and 
shall result in the perianent licensing of those found to have 
performed reasonably. 


(3) A procedure for validating examinations. 


The goals of the proposed program are: 
i ii 


(1) to develop nou-discriminatory fp “sonnel 


selection policies without abiciontng the essential «*ements 


EXHIBIT *! 


of a merit system; 
' 5ld4a 

(2) to build in performance evaiuation as a 
key component of the licensing process; 

(3) to insure employing authorities a broad 


ehotce amonr aualiltied applicants. ‘ 


Accorditly, the primary purposes of the Board of 
Examiners' evaluation at Step 1 are to screen out those who 
fail to meet. levels of minimum acceptable performance, and 
with respect to all other applicants to provide community board 
and Central Board of Educntion hiring authorities with the maxi- 
mum useful information possible so that they will have an in- 
formed basis for making decisions regarding the selection of 
those most highly qualified for service in their particular 


schools and districts. 


I. Job Analysis_ 


Neenennenn ae 


1. The Board of Education, in consultation with the 
Board of Examiners and other interested persons and groups, 
will develop job analyses for all positions for which the 
Board of Examiners is required to conduct examinations. The 
job analysis will be based on a determination of the job 
behaviors which include thc tasks the person is called upon 
to perform, the amount of time devoted to these tasks, their 
relative imnortance, and the knowledge and skills which enable 
@ person on the job to perform these tasks successfully. The 
proposed procedure should be viewed as a model for analyzing 


all jobs although specific procedures might differ for specific 


515a 
a general rule, the job analysis will be developed 


rom data which will be accumulated in the following way: 


A. One resource in developing, the job analysis 


will be analytic descriptions of the handling of 


’ 
such jobs’ by Incumbents presently serving in such 


7 


To utilize this r2source observers 


positions. 


the Board of Education who have a back- 


selected by 


ground in the specific license area and/or are 


trained in job analysis (could be non-pedagogues) 


will be traincd.and periodically retrained in 


observation techniques. These observers will 


visit school sites to observe incumbents in the 


position to develop descriptions of the work they 


are performing. Sufficient numbers of all-day 


visits will be made to the schools over repre- 


sentative periods to insure that the description 


includes both daily and periodic tasks. Observers 


will be required to record all tasks performed by 


fncumbents indicating not only a description of 


the task but the time allotted to each and to 


{indicate the relative importance of the descrited 


behavior in terms of effective performance. To 


includes consideration 


insure that the gnatysi: 


of the widely varying, schools anc a@lstricts in the 


Gity OF ticw fork, tive onmplin,, Will inciude in- 


cumbents in schools vocited in districts of varying 


sociu-economic levels. Any other steps necessary 


to assure meeting the differing needs of various 


districts wil} be fully considered. 5l6a 


B. Observed incumbents will be asked to 
provide the Board with a log, of their activicies 
in the job. 

C. Inewmabents' logs will be compared with the 
observers' lors developed in accordance with (A) 
above. The incumbent's supervisor will evaluate 
both the observer's log and the incumbent ts des- 
eription to determine the relative importance of 
the described behavior in terms of effective per- 
formance. The job description wiil incorporate 
observed and reported data, together with the super- 
visor's judgments. 

D. The Chanceller, Community Superintendents, 
Community School Boards and/or Parent Associations 
will be consulted as to their perceptions of the 
job. Such perceptions shall be considered in the 
development of the job description. 

E. Asa further effort to insure the soundness 
of the job analyses, the Poard of Education will 
subject ne analysis to review by the following: 

1. A Community Superintendent or Central 
School Superintendent. 


29. A collere or university specialist 
in the relbewane erea. 


3. A personnel specialist from outside 
the Hew York City School System, 


h. An incumbent supervisor in the relevant 
category. 
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5. A Comnunity School Board represe’.ta- 
tive designated by the Chancellor. 


Where there is an appropriate group which is rep- 
resentative of any of the aforcnaid caterorics, the Board 
ulil sev desci;viees GVon such proup. However, bud Tieal 
selection shall be by decision of the Poord of Education. 

The desimnees shall review cach job analysis and 
shall male recemmondations to the Board concerning, same. The 
decision of th: Board of Education, however, shall be final. 

2. fased on the data developed in “1" above, the 
Board of Education shill prepare a job analysis and descrip- 
tion for each position for which examinations are to be con- 
ducted. This job analysis shall set out and fully elaborate 
all of the importint qualities ani/or behaviors necessary for 
performance or the jabs Tt shatt also indicate the relative 
importance of ‘he various qualities and behaviors and the de- 
gree of significance each has in determining overall effective 
performance. In drawing up these analyses the views of in- 
cumbents, their supervisors and those persons consulted pursu- 
ant to "Db" above, us well as pertinent research literature 
ahall all be taken Inte accoun 

Tne Chancellor and the Board of Education will also 
utilize the procry of develoning job analyses to review 
exicting, job tities, eanbining Litles ant/or ereating new 
tities, wWhece eel hte 

Ace further Aspe. af preparing joe analyses every 


effect wili te mete 0 iden. ity common elements in jobs: which 


micht end ticmeeclve: CO ada: eoseont in a common tent. Similarly, 


. 518a 
rjard of Examiners to identify common elements 1a jobs which 


r Jent lend themselves to assessment in a common test. 

In order to insure broad public acceptance as to 
{he objective implementation of the procedures set forth 
herein and in "1" above the Board of Education will retain 
a recognized econ ins irm to develop and prepare the first 
three job analyses as prototypes pursuant to the procedures 
set forth herein and in "1" above and/or such other pro- 
cedures as the firm deems appropriate. The prototype analyses 
shall cover the positions of Principal - Elementary School, 
Assistant Principal - High School (Supervision), and Assistant 
Principal - Elementary and Junior High. These positions cover 


the largest number of people in the supervisory categories, 


thus permitting the program to start in a meaningful way. 
These analyses will thereafter serve as models for future 

job analyses to be developed by the Board of Education. In 
doing these analyses the consulting firm shall be guided by 
the goals described sane cf identifying common elements in 
jobs which might lend themselves to assessment in a common 
test, and of reviewing existing job titles with a view toward 
making recommendations to the Chancellor and Board of Education 
regarding the combination of titles and/or creation of new 
titles, where appropriate. ‘The consulting firm shall also 
recommend a program for the selection and training of persons, 
to conduct subsequent job analyses. Tne Board of Education 
has designated American Pastituccs for Rusearch, 3301 New 
Mexico Avenue '.W., Wishington, D.C. 2a00u1IG, as its consultant 


. 


in connect.ion with the developrent of job analyses for prototype 
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ex.minations. The Board of Fducation, in its discretion, 


ma/ use consultants to perform services in the development 


3. The Board of Examiners will determine the 
feasibility of the development of tests for families of 
jobs that require similar qualities and behaviors. It would 
then be possible for similar tests to be administered for a 
group of jobs that call for similar knowledges, skills and 
behaviors. The Board of Examiners, in its discretion, may 


use consultants to perform services in this connection. 
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II. _Job-Relatcd Examinatlon’ 520a 

The Board of “xaminers will develop examinations 
based on the aforesaid job analyses which measure the appli- 
eant‘s capacity to perform the significant job requirements 
as indicated by the analysis. This examination process will 
be divided into exe stepa. Step 1 wilt eonstst of a series of 
tests to be given to all eliyible applicants for the primary 
purpose or evaluating the applicants" strengths and weaknesses. 
All persons who meet levels of minimum acceptable performance 
under Step 1 shall be declared eligible for provisional, appoint— 
ment to the position in question. Step 2 of the exanination 
process will be administered to those persons who secure such 
provisional ar sintment. It shall consist of an on-the-job 
performance ev« uation at the end of one school year of pro- 
visional service. Any person found to be performing reasonably 
in the Step 2 evaluation shall be awarded a permanent license 
for the position in question. 

A. Description of Step 1 Tests 

A variety of tests may be used at this stage. 
They may or may not inelude written examinations, depending on 
the needs of the particular situation and the nature of the 
qualities being evaluated. These Step 1 tests are likely to 
4nclude some combination of the following: 
1) Situational tests or job simulations - 

tests which place the applicant in a realistic 

foe scth ing aol ¢oit ujom nim to ezn all apart o- 

priate behavior. Taus, if administrative ability 

is a job requirement, an in-lacket test — be 


used. This tent ugts a hypothetical but realistic 


in-bashet contalaing leitbers, memoranda, records 


by diy! % 
\ : hig 9 , 
\ if Aj ‘ 
ascpeditinlt i Te Tn Te Ey ee ee eT Te ee . 


of incoming telephone calls and other documents 
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normally found in the in-basket of the school 
administrator. The apniicant is given the 
necessary ciackpround information concerning the 
school in which, as principal, he would be faced 
with the specific in-hasket. He is told that he 
is the incumbent principal and that he must te- 
spond to the materials as he would actually respond 
on the job by 
a) handling certain matters himself immediately 
b) handling others himself at a later time 


c) delegating some to staff for immediate 


action and 


RE tas octet met ti— 


d) deiegating others to staff for later action. 
] After . period of study of the documents, 
| he may be asked in an interview to give the 
reasons for the decisions he has made in 
nandline the in-basket and to defend them. 
2) Job knowledge tests - written and/or performance 
tests whith measure the applicant's knowledge cf 
subject matter required by the job. Thus an appli- 
cant for the position of Assistant Principal 
Supervision (Mathematics) D.H.S. might be required 
to demorstrate a knowledge of the curriculum and 
materials of his subject to the extent that the job 
analysis identifies that knowledge as important to 
the performance of the job. 
3) Tests of communtcation skills - written and/or 


oral tests which will requir the applicant to 


am, 


cee 
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demonstrate his ability to write and speak effcc- 
522a 
tively to students, staff, parents and the community. 

4) Tests of special experience - tests designed to 
give an applicant the opportunity to demonstrate his 
knowledrpe 6° special areas that may be deemed impor- 
fant by napticular Coir tunity School Boards, €-§-; 
knowledge of a foreign language. or knowledge of the 
culture of a particular ethnic group. 

5) Physical and medical test. 

6) Inspection test = evaluation of the performance 
of an appiicant on the Job currently held. Every 
effort will be made to tnelude such evaluations in 
the Step 1 assessment, airthough conslderations of 
cost may preclude extensive performance evaluation 
in some examinations involving large number of 
applicants. 

In order to insure that tests are job related, they 
will be creatcda by closely matehing, the tests and test tasks 
to the important clements of behavior on the job as identified 
in the job analysis. The job analysis will be reviewed and 
selected behaviors listed will be translated into test tasks. 
Te sampling of test tacks will reflect in microcosm the con- 
plex conditions of the job itself. Each test item in a written 
test and each test, be jt interview or <isgilation, will be 
{dentifited by a code referring to a specific ttem on the jobd 
analysia:... This erurs rafepenurn aydlom wilt insure Chat test 
tasks used will be based on th: job anilysis. Test items will 


reflect the relative disnortunce asadened tu the task int tas 


job analysis. 
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B. weperting of Results of Step 1 523a 
In the past, specific weights werc attached to 


each one of the battery of tests with a few exceptions (written 


English, physical and medical, and records were rated either 


satisfactery cor unsatisfactory). A candidate had to achieve a 


weighted average of 60 per cent on the battery of tests to 


If a candidate scored less than 50'per cent on any part 


If he obtained 50 per 


of: 


| 

| 
pass. 
of the examination, he was eliminated. 


cent or more, he was continued in the examination but he had 


to compensate for marks lower than 60 per cent because he had 


to achieve a weighted average of 60 to pass. 
To adapt the testing system to the needs of a 


Community School Board type of administration, test results 


will be reperted in a manner completely different from hereto- 


fore. Instead of a composite grade, a profile of performance 


will be made available to the Central Board or to Community 


School Boards, whichever has jurisdiction, for each qualified 


candidate. This profile will present an assessment of the 


performance of each qualified candidate in all tests without 


specific weight and without exact composite numerical grades. 


The assessment will also include a narrative 


report of the candidate's performance in the various areas 


tested as previously determined by the job analysis. For 


example, the assessment of a candidate ina principal's examin- 


ation might report on the following, areas: 
1) managerial abilities (e.g., handling of 
a variety of problems by proper organization, | 
planning, inagination and decision-making) 5 


2) supervisory abilities (e.g., competency 


to observe classroom teaching insightfully and 


BP cu 


ee 
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to contribute to the improvement of teacher 524a 


performance); 

3) interpersonal relationships (¢.g., com- 
munications skill, sensitivity to the role of 
participants in a crisis ei tuavion, awareness of 
the human factors onerative in a school setting). 
The standards for assessment of performance on each 

test will be established by experts chosen by the Board of 

Examiners in the areas covered and assessments in accordance 

: therewith will be made by examiners chosen for their expertise 
in the see covered by that test. Thus, in evaluating per- 
formance on an administrative in-basket, examiners will be 
drawn from a pool of experienced administrators in education 
and industry who will have participated in the Job analysis or 
who will be familiarized with the adminstrative component of 
that analysis. The Board will include, where available, as 
assistant examiners and cxamination assistants qualified per- 

N sonnel, from the varied racial and ethnic groups represented 
in the New York comaunity. The examiners will rate performance 
in accordance witt. a scoring guideline that will identify the 
significant elements in the in-basket and levels of minimum 

~ acceptable performinc> based on the guideline. 

Sinllariy, {n a supervisory simulation, standards and 
the level of minimum acceptable performance would be set by 
pooling expert opinion of those who had wide experience in 
supervising instruction in a variety of schools and who were 
thoroughly familiar with the content and methodology of the 
curriculum arcaus involved. Thay would view a representative 


videotaped lesson, and identify significant areas of strength 


and weakness In the performance of the teneher conducting 525a 


the lesson and spect file ways in which that performance could 


be impraved. The candidate would appear before one of a number 


ef pancia of examiners consisting of school supervisors, 


university professors or other experts in supervision famtlier 
wtth the enectfte subsert ore® and would evaluate ye leseon 


and present a progran he would seek to implement to impreve 


1 


tho (ercnorla perrorsice. 


No assintant examiner or examination assistant shall 


participate in the adininistration of any test without having 


first received appropriate triining. 


A sample profile format follows on the next page. 


Sample Assessment Profile Pormat 526a 


(The tests indicated are merely examples of those which 
might be used. Total assessment is not restricted to 
these examples.) 
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Fe 
Understandiag of Fasontial Prineiples 
of Adminis tive Behavior 

(as measure. by "in-basket.” 
situations) 
C0 eee 
Ability to Evaluate 

Observed Classroon Teaching, anc to 
Effect Improvement 

(as measured by response to actual 
teaching) 


nents 


nna 


————————— 
Understanding of Human Relations 
Principles Involved in School 

Management (as revealed by reaction 
to taped situations) 


es 


a ea 
Understanding of the Educational 
Process in the Urban Setting 

(as revealed in a written test on 
educational literature - for entry 
level as chairman or ass icbant 
principal) 


ee a et te A 


Coe aes 
Communications Skills: Ability to 
Communicate to Stafi, Students, 
Community 

(as revealed in simulated ¢ sks) 


eee ten ewe mae a 


ALLOA OO 


Skills in English Communication 
(as revealed in a writing, sample - for 
entry level as chairman or assistant 
principal) 


eee 


Inspection Test 


eee eC AO OCCT 


Physical and Medical Test 


a cece nt te en ne ee Ae LT ee 


focer |, Tusludin ena ne | vod 
evaluation of past experience 
(ineluding fingerprint chee: required | 


by Board of Education) 


Special Skills Toasted at Applicant's 
Request (e.-, knowledre of Spanish) 


re ee « 


ccc ee en e CO ee er oo meee ne mat a A A 


ee \ 

Special Pxpertence : | 

(identified fron vita supplied by 
applicant and verified by tiv joard fo ee 
of Examiners) 


wipe’ 
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though the candidate is qualified overall, he is «novualified 


in one of the areas tested. In the event that the performance 
of the a olicant is determined not to mect the level «f 
minimum acceptable performance in an area deemed essen’tjiai 
by the job analysis, he would be rated unqualified and iio’ 
recommeided for licensing and a place on -the qualified list. 
This level of minimum acceptable performance shall be set 
with a view toward screening out the uequalified, consistent 
with the primary purposes of the Step 1 :valuatior which are 
to ensure employing authorities the bro; dest possible choice 
among qualified applicants, and to provide witu respect to 
suc applicants the maximum usefui invorma’ 7a possible so 
thet the employing authorities will have 11 informed basis 
for makinz decisions regarding the select of those most 
highly qualified for serv .>" <n their -earticular schoo’s and 
districis. A rating of unqualified in one or more areas no 
dzemed essential by the {0 analysis would not prevent the 
applicant irom being placed on the qualified list, although 
said ratings would of course be reflected in the applicant's 
assessment profile. 

Upon receipt of the list of qualified eligibles, 
together with their assessment profiles and narrative report, 
each Community School Board could evaluate the indicated 
achievement levels of each cligib:: in the lights of its 
own neeis, attaching, more importance to some aspects of the 
total assessment and less importance to others. Thus, & 
candidate who did poorly in English communication but well 


in administration and supervision might be more acceptable 


te one Community School Board than to another. Another 528a 
aspect of the profile would be the evaluation of additional 
skills claimed by the applicant; thus, an applicant who 
claimed fluency in Spanish would be tested for that skill 
and this additional qualification will be reported together 
with the other anpects of his UGS dene 

The Board of Exaniners would undertake to 
provide a monunl to help Community School Boards interpret 
the results reported and would coniult upon request with 
any Community School Board in matters of personnel 
selection. Further, im the case of applicants whose assess- 
ment profiles did not include adequate evaluations of prior 
performance, the Board would provide additional assessment 
service. Each Community School Board could submit to the 
Board of Examincrs a list of reazenable length of qualified 
persons in whom they were interested for a particular 
supervisory position, for an assessment of their performance 
in the job they currently hold. The Board of Examiners 
would evaluate by an on-the-site inspection by a team of 
experts each eligible as to performance in hts current job, 
wherever he may be serviny,, and submit a report of its 


findings to the Community Sehool Board. 


C. Frequency of Step 1 Examinations 
and Establishment of Continuing 
Blifibie Jdsts Yor Percons With 
Provisionnl Licenses 


We 2 pk Pew ere cel 4 . . a pa cee * 
Die poe be A, ami a6y volt leickh -arrue- 


ment ts conditioned upen, the entry of 4 reicdial order by 


the Court providing, that, in order to pee iaie Clie opportu: cly 
for qualificd minosrity applieants to compete for Bupervifory 


positions: 
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+. The Step | sereeningn process for any particular 
examination chall be complacted as auickly as is administratively 


feasible. : 


>. Step } examinations for every separate job 


titie for which there are vaconeties shill be ordered by the 


Chancellor in connection with the Community School Board 


16 iG iS administratively 


Consultative Council 5 frequently 4 


feasible for the Roara of Examiners to sive such cxaminations 


| 
and it appears appropriate, $n order to insure employing a 
authorities the broadest possible choice of qualified appli- 


cants. In any event, satd examinations shill be ordered and 
‘hy provisional licenses 


given whenever the number of percont 


on an existing Viet falls vo 50% of the number on the list 


at the time of its eatablishmnent. 
q. Successful enndidates for provisional licensure 


shall have their names added to, and shalt remain on, eligible 


lists for a period of four yours. 


The provisions of saragraphs "1" through "3" above 
i i‘ H 


shall be effective for a poviod of 5 years from the date of 
the anneuncenent af the Tact protelype examination, notwith- 
stand ims any provisien Lo the conlrary contained jn any law, 
regulation aor collect iv pareainings APECOMCILY , includins, 
specifies tly H.oY. balun. tae { enon) 8 0T). 

The announcenent of examinal ions by the Board of 


the ciring. of euch exaninition 


Eyaminers shall not preved 


by more than aig weeks. 


530a 


D. Phasing Out of Interim System of Licensing 
on Basis of Performance Evaluation ani of 
Interim Svstem of Filling Vacancies 
1. With respect to each supervisory job titie, 
the interim systemeof licensing on the basis of performance 
evaluation established pursuant to this Court's orders of 
July 12, 1973, shall continue in effect for each job title 


until: . . 
a) The promulgation of an announcement of an 


examination for that title by the Board of 


Examiners at which time the interim system 


of evaluation for such title shall forthwith 
cease, provided, however, that all persons 
eligible for performance evaluation whose 
applicatiors for such evaluation are filed 
prior to the date of said announcement, shall 
be evaluated pursuant to the interim system 
of performance evaluation and, where 
appropriate, licensed. 

’b) If no announcement of examination is made for 


any particular job title, the interim system 


of performance evaluation shall cease on the 
later of the following dates: 
(1) The expiration date of any existing 
elipible list for a particular Job titie 
‘(2¥ one year from the date of the announcemen 
by the Board of Fxamincrs of the last of 
the aforementioned three prototype 
examinations. 
Notwithstanding, the foregotng, provisions of this 
subparagraph (db), all persons cligible for performan: 
evaluation whose applications are filed prior to the 


shall be evaluated 


Ayres: 05 
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pursuant to the interim system of performance evaluation and, 
where appropriate, icensed. 53la 

2. Pending the promulgation of a list of persons 
provisionally licensed for a particular job title pursuant 
to Step 1 hercof, vacancies in such title shall cont‘nue to 
be fllied in accordance with the provisions of Paragraph Vili 
of the July 12, 1973 orders of this Court, provided, however, 
that licenses shall not be granted to persons filling such 
vacancies in accordance with the performance evaluation 
procedure except as provided in paragraph "1" above. 

3. Upon promulgation of a list of persons 
provisionally licensed for a particular job titie pursuant 
to Step 1 hereof, the interim system of appointment to 
positions in such title described in Paragraph VIII of the 


orders of July 12, 1973 shall forthwith cease. 


E. Description of Step 2 Test 

This step shall consist of on-the-job performance 
evaluation, after one schcol year of service, of any person 
given a provisional appointment after qualifying under Step i. 
A candidate will be rated satisfactory under Step 2 if he : 
demonstrates reasonable performance on the job and will 

then be awarded a permanent license for the position in 
qucstion. 

The on-the-jeb evaluation will assess the candidate's 
performance in terms of the essential elements of the job 
analysis through such activities, for example, as the following: 
classroom visits and a study of the applicants' efforts to 


improve teacher performance (c.., post-observat ton 


532a 
conferences and reports, workshops, inter-visitation program, 


and demonstratton lessons); interpersonal relations with 
staff and students (as evidenced, ¢-G-> in staff meetings, 
consultative council meetings, and meetings with student 
government officers); relations with parents and community 
(as evidenced, e@-f 5 in planning parent mectings, in 
{involving community eersons in advisory canacitics, in 
using community resources in the instructional program) ; 
discussion with ithe applicant and his supervisor concerning 
the goals of the school, major problems that the applicant 
has faced in achieving these goals, and steps he has taken 
to solve these problems and provide @ wholesome school 
environment and an effective {instructional program. 

The panel conducting, the evaluation will, in 
assessing the applicant's performance, consult with 4 proad 
cross-section of person familiar with the applicant's work. 
For example, in the case of an elementary school principal, 
this would norn2lly include the candidate's supervisors, 
nis fellow administrators, teachers working under him, 
students and parents, as well as any persons designated by 
the community superintendent or the community poard. 

F. Staff 

Tne Board of Examiners shall have as a4 major goal 
the development of a full time, permanent staff of persons 
drawn not only from cancation, but from such other fields 
as testing and measurement and privete {industry , as well as 
the use of exmmination assistants from outside the educational 
profession. Tie Board shall develop and publish appropriate 


written selection eriteria for both assistant examiners and 


: 
i 
é 
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examination assistants and shall develop appropriate 


training procedures for such staff. 
No member of the staff shall participate in the 


administration of any test without having first received 


appropriate trainti:. Both assistant examiners and 


examination assistants shall include, where available, 


qualified personne) from the varied racial and ethnic 


groups represented in the New York community and from 


outside the education profession. Nothing contained herein 


shall be -deencd to contravene the provisions of Section 2659 


of the Hew York State Education Law regarding the nomination 


or approval by the Chunecellor or Community Superintendent of 


examination ascistants. 
GS. Appeal Erocedurss 


The program described above will continue the 


same safeguards that are currently in effect, namely, the 


right of the applicants to full disclosure of the guidelines 


used in the assessment process with the rigpht to appeal from 


any or all of the findings at both Step 1 and Step 2. Such 


appeal shall be made in accordance with Section 13 of the 


By-Laws of the Board of Examiners (copy of which is attached 


hercto) and may challenge any aspect of the examination 


ineluding whether the examination is consistent with the 


general strnd¢rds and procedures for testing at Step 1 and 


Sten 2. 


The Boare of Examiners will apprise applicants 


edyf 


of their rirht to appeal, of the procedures to be followed, 


and of the procedures avallable to obtain review of any 


appeal denicd by the Board of Fxaminers. 


4 
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The hoard of Examiners will develop procedures ae 


to validate Steps 1 and 2 and the testing program on an 


on-going basis. In order to assure that these validation 


procedures are properly developed and nerformed, the Board aa | 
of Examiners shall designate Development Dimensions, Inc., rey 
Suite 419, 250 Mount Lebanon Boulevard, Pittsburgh, Pennsyl- as 
vania 15234, as its consultant or consulting agency to design ee 


e.g and conduct validation studies of the examinations for the 


vines three prototype positions referred to in Section 1 supra. 
Bese *: 
nae In carvying out its task the consultant or consulting agency 
ue shall be directed to design and implement validation pro- 


cedures which are consistent with applicable law. The pro- 


Ae cedures so developed will serve as a model for subsequent 


-Jidations, as appropriate. 


che Ss - 
> 


toe The testing process shall be revised as necessary 
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to make it consistent with the findings of the validations. 


- 


‘“e 


-. 


IV. Licensing Procedure i iG 
Candidates who are found to be qualified as . ee 


tes 
ES, 


> Ste 


> 
‘es 


“result of the Step 1 procedures described above shall be 


ee 
f 


placed on an “eligible list" promigeted by the Board of 
Examiners and certified to the Division of Perscanel of oe 
Board of Education. Persons on such a list shall be eligible | 
for provisional appointment to the jobs for which they nave. 
been tested. Once such a list has been established, appointin 
authorities shall be free to fill supervisory vacancies with: 
persons who possess such provisional licenses or with persons a. 
who possess licenses granted pursuant to the interim system : 
of performance evaluation or with persons who possess licenses i 
<5 


granted pursuant to the previous system of examination, 
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oe gehood year the provistonal 


renec With Step ? hereo 


‘ 


hos. CHRAL I verb foo hte pepParsed solisfactorily in 

accordance vii Ow Step 2 ouethe-job evaluation deseribed 
ustdor shall be 

gomeToled atihin the nemester following: the required sehool 


vecr at prey cctong 


Reporting Reauirenents 
A. For the purpose of determining or securing 
compliance with the Final Judgment, and for no other purpose, 
and subject to the entry of an appropriate protective order, 
the defendants will provide the following information with 


respect to the three prototype examinations described above 


in this Plan at the times indicated below: 


1. Job Analyses 
Cio HK lina Vaslinent % tack. 


a the job analyses, 
te psa Wee 017 07 ee 
i} 


Board of Education will ewemip 


iy A Avakattie 
i Ne the, a ae report -ehedereoatey 


cee Coie 17> 
Counce. 


2. ea t_of Step 1 examinations 
oe wat (/ aus diye Ce 
NPi'y tok shee inevémen of the holding of 
a prototype examination, the Board 
of Fxantner:s will provide plaintiffs! 
counsc. and the Court wlth a descrip- 


tion of the sexope of the e ie spade 


a ae a a 


ish racio 

(2) Cortes of the examination announce- 
ment wlll be submitted to plaintiffs! 
eourse) “ad the Caurlh at the time 


eth furmaineauent I Pleased. 


- Mv. aef “re. 


a) 
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(b)  Vroampity after cxaminations are 
held, the fotlowing; shall be given 
io plaineif fs! counsel and submaltted 
to the Court. 


Copins OV exuminabiote. 


tes , 


-\ 


(2) A rweport on the racial and 


ethnic composition, 1.e., 


DEG Oe aty 


« 
<r 
- 


black, Puerto Rican cr non- 


minority, of the examination 


& 
Se 


= 


assistants who administer the 


ry re 
eae 


examination. 


f.. 
SB ot: 


wei wey at 


Pie! 
ties 


A report on the racial and 


a 


[ gee ae 


ethnic composition of applicants 
taking, passing, and failing 
the examinations, 
A copy of the notice given te 
applicants regarding their 
right of appeal. 
Development and Administration of Step 2 
examinations. 


Promptly after the completion of any 


prototype Step 2 examinations, the Board of Examiners shall | a 


‘give to plaintiffs' counsel and submit to the Court a re- 
port on the ethnic and racial composition of eeeuinacion 
ar sistants who eonducted Step 2 examinations. 

9. Validat ton Reports 


(9) Preomptly after the holding of 


aT 


Pere, 


each Step 1] prototype examination, 


= 


the Board of Examiners shall give 
pininttffs' coursel and submit to 


tis Court a ceport om che cuntent 


S378. 1idiby of such examination. 
(u) A Copy of the Consultant 's validation 


atudtios gshali be given to the 


rhe ER aD 


plaintiffs! counsel and submitted to 


eh Court promptly after 10 1s re- 


ceived by the Board of Examiners. 


BR. bor the eurpose of determining or securing. 


compliance with this Final Judgiaent, 


Ae r 4 . 
and subject to any legally Kecdsatanre privilege, and the 


entry of an appropriate protective order, defendants will 


provide plaintiffs‘ counsel with such other information y sh 


s described in the : s 


respect to the three prototype examination 


Plan as is necessary for them to make 2 determination re- 


garding compliance with this Judgment, provided that: 


1. plaintiffs’ counsel give defendants 
reasonable written notice of the 
4nformation required; and 
the information requested is relevant 
to a determination eonaceoine oa 


pliance with this Judgment; and 


the information requested will not 
jeopardize the security of examina- 


tion: oz the confidentiality of the 


bo. Cuda 


idantity of exasaination assistantsSs 


. 
me et 
wt 0%) cn Fie. e 


«te 
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C. Defendants shall supply or make available for inspection any Cj % 
¢ eo La ‘ 


" ‘ . of a a nie 
other material necessary to comply with paragraph X of the Fina! ——: - ” ipl 


of July 12, 1973, or to comply with the Order of March 2S, 1975, to oaiek - Hy 


* 


ee 


o this Plan is "Exhibit A‘'. Plaintiffs' approval of each step is not necessary, “4 
a - 8 
-— oe 
sa “> 
“sg but information is to be made available to plaintiffs (1) so that they may offer - 34 
f. ag 
ae "sag 4 
‘e comments and suggestions which may facilitate rapid implementation of a a Par 
; ‘s y 43 
eat td 
| aS 
constitutional selection system and (2) so that all information necessary to 35 2 ee 
; ae i 
: at 
: e 2 ne tty * 
insure that the new system is constitutional, as implemented, will be collected ; Ag 
Ms i vee: 
<* ‘ Se 2 
ae and available without undue delay. {4 a 
a meet: 
ae . +. 4 
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Memorandum Decision of Judge Tyler, dated 


April 1, 1975 


ton ee 
: 
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BOSTON M. CUANCE, LOUIS C. MEKCADO, 
et al., 


Plaintiffs, 
-against- 


THE BOARD OF EXAMINERS AND THE BOARD 
OF EDUCATION OF THE CITY OF NEW YORK, 
et al., 


Defendants. 


TYLER, D. J: 


This memoran*um relating to the "Order Mouly 


ea 


Vigoge g 
— io 
os 2 
MEMORANDUM 


70 Civ. ‘4141 HRT 


HS a9Y 


ing Final J udgment 


and Order" of March 25, 1975, is being filed simply to explain the rationale 


of that order and, perhaps as well, to assist the transferee judge and counsel 


in. its impl ementation. 


The March 25th order was the result of seve ral motions by all 


parties to this action. My intent in fashioning the order was to balance the 


Board of Examiners' need to be allowed to fashion an 
or 8 


ee 


1 e471 


ew selection sy stem,in 


a eter” 


~~ plage Oe Bore ee we 


Sa a eee 
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accordance with its statutory dutics, with the desire of the plaintiff 
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classes to be reasonably certain that the new system will be implemented 


in a constitutional manner. To achieve this balance, the Poard of Examiners 


and the Board of Education are authorized and permitted to develop and 


implement the new system, according to the Plan agreed upon by the parties 


and subject only to their disclosure to plaintiffs’ counsel of all relevant 


material. 


The March 25th order was fashioned with the hope and expectation 
that defendants may be benefitted in the discharge of their public duties by 


another party or parties, with a different viewpoint, comment on 


having 
* % 


plaintiffs' counsel are 


perceived deficiencies jn the new system. Hence, 


entitled to review all relevant material as soon after it is available to 


defendants as is practicable. To the extent there is any conflict in the 


March 25th order regarding the time at which material must be made 


availeble to plaintiffs' counsel (absent a protective order), that conflict 


should be resolved in favor of the earliest disclosure. 


Unfortunately, based on the history of this litigation and the apparent 


absence of trust between the parties and counsel, it is not unlikely that 


conflicts will arise. To avoid delay in the implementation of a new, 


s 


. 


o 
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constitutional licensing system, I have tried to limit the litigable issues 542a 
while insuring that the new system will be constitutional, Essentially, 
defendants must provide all relsvant information, absent an order to avoid 
dissemination of test questions or of the identity of examiners before a test 
is given. If any protective orders must be entered, they should seek only 
to protect the integrity of the new, compctitive system; they should not 
permit defendants to avoid disclosure of material for any other reason which 
I can foresec. Moreover, defendants should not need to invoke this court's 
jurisdiction except, possibly, after a test has actually been developed and 
examinations are to be administered. 

It should be noted that, while they are to be granted access to 
material developed for defendants, or in the possession of defendants, which 


relates to the nev: system, plaintiffs are not given any formal power to affect 


Daeg 


the manner in which the tests are developed and ideninistered as long as 

the March 25th order and the Plan annexed thereto are followed. But, as a 
practical matter, it is to be hoped that defendants and their counsel will 
informally consider any suggestions plaintiffs care to make. Such receptivity 


may enhance the possibility that a new system will be implemented without 


~3- 


+ 
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further litigation; it may also result in a better and fairer licensing, system. 543 
a 


But the defendants need not agree with plaintiffs’ suppestions, ard 


to force their views through court orders. The 


plaintiffs will be impotent 


only court .cvicw will be of the new system itself (rather than of its develop- 


. ee 


ment), as each new test is implemente 4d, to determine whether it is 


constitutional, not to determine whether it is the best test or the fairest 


test which could conceivably be created. 


t forth in the’ March 25th order and 


owe Oe we et 


The reporting requirements s¢ 


Plan attache: thereto will insure that no lengthy and costly discovery will be 


4 necessary to aid in the determination of whether the test meets constitutional 


standards. Requiring such continual disclosure is justified in this instance 


at ee 


because previous, adamantly contested litigation in this case established a 


prima facie case that the old examinatior. and licensing system violated 


federal constitutional guarantecs. The community is entitled to the 


competitive examination licensing procedure, which its legislature has 


_—_—. 4. 
- 


determined appropriate, as soon as possible. The community is also 


tee 


catitled to a system which satisfies constitutional standards. The March 25th . 


order and Plan was entered to effectuate these goals as well as possible. 


Dated: April 1, 1975 a - 
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Plaintiffs'Notice of Motion, with proposed 
amended complaint, dated September 23, 1975 


a el - 54547 


IN THE UNITED@STATES DISTRICT COURT 
FOR THE SOUTHERN DISTRICT OF NEW YORK 


LOUIS C, MERCADO, et al., 
Plaintiffs, " 70 Civ. 41461 


P. 


~against- 


THE BOARD OF EXAMINERS AND THE BOARD OF d ICE OF MOTION 
EDUCATION OF THE CITY OF NEW YORK, et al., $ R_ LEAVE T 
INT 


Defendants, 


COUNCIL OF SUPERVISORS AND ADMINISTRATORS OF 
THE CITY OF NEW YORK, LOCAL 1 SASOF, AFL-CIO, 


Defendant-Intervenor. 


W. Bernard Richland, Esq. 
Corporation Counsel 
Municipal Building 

New York, New York 10007 
Attn: Leonard Bernikow, Esq. 


Saul Z. Cohen, Esq. 

Kaye, Scholer, Fierman, 
Hays & Handler 

425 Park Avenue 

New York, New York 10022 

Leonard Greerwald, Esq. 

Frankle & Greenwald 


80 Eighth Avenue 
New York, New York 10011 


PLEASE TAKE NOTICE that upon the papers filed herewith, — 
plaintiffs will move this Court pursuant to F. R. Civ. P. 15 for 
leave to amend the complaint herehY as indicated in the attached 
Amendment, on the third day of October, 1975, at the United 
States Courthouse, Foley Square, New York, New York at 10:00 A.M. 
or as soon thereafter as counsel may be heard. 

Dated: New York, New York / rae 
September 23, 1975 vs 
Respec* fully ‘submitted, 


J a 


ELIZABi : 

(Legal Action Center of the 
Cit, of New York, Inc.) 

271 Madison Avenue 

New York, New York 10016 

(212) 679-6502 
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GEORGE COOPER 
435 West 116 Street 
New York, New York 10027 


JACK GREENBERG 
10 Columbus Circle 
New York, New York 10019 


JEANNE R. SILVER 
20 West 40 Street 
New York, New York 10018 


Attorneys for Plaintiffs 
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IN THE UNITED STATES DISTRICT COURT 
FOR THE SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE, 
LOUIS C. MERCADO, 


Plaintiffs, 
70 Civ. 4141 
-against- (M.P.) 


THE BOARD OF EXAMINERS AND THE BOARD OF 
EDUCATION OF THE CITY OF NEW YORK, et al., : AMENDMENT TO 
Defendants, SCT AINE 


COUNCIL OF SUPERVISORS AND ADMINISTRATORS OF 
THE CITY OF NEW YORK, LOCAL 1 SASOF, AF!.-Ci0, 


Defendant-Intervenor. 


The Amended Complaint herein is hereby amended to 
add the following supplementary allegations: 

la. Jurisdiction of this complaint is further 
conferred by 42 U.S.C. §2000e-5(f) (3). 

14a. Defendant Board of Examiners and Defendant 
Board of Education and the other defendants named herein are 
government, governmental agencies and/or the agents, employees 
or controlling officials thereof, and are thereby employers 
within the meaning of 42 U.S.C. §§2000e(a), 2000e-2(a). 

14b. Defendant-Intervenor, the Council of Supervisors 
and Administrators is a labor union or organization within the 
meaning of 42 U.S.C. §§20U0e(a), 2000e-2(L). 

25a. The actions of defendants described in paragraphs 
15-24 hereof discriminate against plaintiffs and their classes ) 
with respect to compensation, terms, conditions and privileges 
of employment and operate as a failure or refusal to hire 


plaintiffs and their classes, all because of the race, color or 


igin of plaintiffs anu their classes. As such, the 


& 
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actions of defendants violate plaintiffs' rights pro‘ected by 


42 U.S.C. §2000e-2(a)~(c). 


Dated: New York, New York 
September 23, 1975 


ELIZABETH | 

(Legal Action Center of the 
City of New York, Inc.) 

271 Madison Avenue | 

New York, New York 10016 | 

(212) 679-6502 | 


GEORGE COOPER j 
435 West 116 Street 
New York, New York 10027 


JACK GREENBERG 
10 Columbus Circle 
New York, New York 10019 


E R. SILVER 


20 West 40 Street 
New York, New York 10018 
i 


Attorneys for Plaintiffs 


Board of Education's Notice of Cross-Motion, 

dated October 2, 1975, together with support- 

ing affidavit of Elliot P. Hoffman, sworn to 
October 2, 1975 


MADAM 


IN THN UNITED 


BOSTON b CHD 
HLOUIS C. MEPC. 0, et al., 


Plaintiffs, 70 Civ. 4141 
¢ (AP) 
¢ 
E POAPRD OF EYAMINEPS AHD THE BSOAFD NOTICE OF CPUSS- 
F EDUCATION OF THE CITY OF NEW YORK, Hy pula TO abeplpcer! 


Defendants. 


Plizabeth B. DuBois 

(Legal Action Center of the 
City of New York, 
271 Madison Avenue 

, New York 10016 


Inc.) 


Saul 2. Cohen, Esa. 

Kaye, Scholer, Fierman, 
Hays & Handler 

425 Park Avenue 

» Rew York 10022 


Leonard Greenwald, Esa. ~. 
Frankle & Greenwald 


80 Eighth Avenue 
New York, New York 10011 


PLEASE TAKE NOTICE that upon the pavers filed 
i herewith, defendant Board of Education will move this Court 
pursuant to Ls R, Civ. P. 12b(1) and (6) for an order dis- 


nissing the - 


New York, New York 


i Dated: 
October 2, 1975 


STATES DISTRICT COUPT 
OF THE dled ote DISTRICT OF NEY YOR 


OF 0 DO AO PD eS OD Oe Oy DS OO OP Oe we SD OD 2 ao Oe > Oe am oo Co me om ae ae mm KM 


wow oe new eewe 


EY © eewee © Serban ween enn ae: et: 


a Se Oe te ee ein et ne eaten 


itle VII allegation of the complaint if amended 
| to include came, on the third dzy of October, 1975, at the 
| United ate -es Courthouse, Foley Square, New York, New York 


at 16:00 r. M, or as soon thereafter as counsel may be hearc. 


W. BERNARD RICHLAND 
Corporation Counsel 
Attorney for Defendant 
Municipal Building 
New York, N. he bt 


ELLY? —° ae on 


| 
| 
| 
' 
Respectfully submitted. 3 
Assistant ied as Counsel) sa | 


UNITED STATES DISTEICT COURT 
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BOSTON M. CHANCE, LOUIS MERCADO, 
et al., 
Plaintiffs, ARETDAVL' 
-against- 
70 Civ. 4141 
THE BOARD OF PXAMINEFS, etxral., 


Defendants. 


STATE OF NEW YORK ) 


COUNTY OF NEW YORK) 


ELLIOT P. HOFFMAN, being duly sworn, deposes and 


1. I am an Assistant Corporation Counsel ir the 
office of W. BEPNARD RICHLAND, Corporation Counsel. the 
attornev for the defendant Board of Education. T submit 
this affidavit in opposition to the plaintiffs" motion. 
to amend the complaint to add a cause of action under 42 
U.S.C. 2000e, et seq. (Title VII) and in support of 
defendant 's motion to dismiss the complaint, if amended. 

2. The motion is supported by neither memorancun 


nor affidavit. However, it is clear that the memorandum 


submitted by plaintiffs regarding the motion of the defen- 


dants for reconsideration of the counsel fee issue relates 
to the motion as well. 

3. Defendant opposes this motion to amend the 
complaint on the grounds that: 

(a) The issues have already been 


litigated and are covered by a 
final consent decree; 


ef 


it should 
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(b) To the extent, if anv, that the 
issues are not covered by that decree, 
they are moot in that the practices 
described in the previously amended 
complaint are no lorger in existence; 


(c) By the terms of the above-mentioned 
consent decree, plaintiffs waived all 
other claims which they might have and 
at the time the decree was entered a 
Title VII claim could have been 
asserted after the fulfilling of the 
jurisdictional prerequisites. 


3. In the event that this complaint is amended, 


be dismissed because: 


(a) Plaintiffs have failed to exhaust 
the requisite administrative remedies; 


(b) It is barred by the statute of 
limitations: 


(c) The complaint is moot in that the 
conditions complained of are no longer 
in existence and those conditions have 
been changed in a manner agreed to by 
plaintiffs. 


4. As plaintiffs have apparently done we = on 


our memoranda submitted on attorney's fees motion. 


0 WS Oe SH wi oe eo ae we ce om a oe ow, 


UY, Le, Lose 


Sworn to before me this 


2nd day of October, 1975 


SHARON L FEISENBAUNY 
Commissions: ri Oreds 
City of Kew fotk ha 2 276? 
Certificate hes in tea York Ccu’y 


Commission Expires March Jy i877 
An kL te pa 
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Opinion of Judge Pollack dated February 11, 1976 
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UNITED STATES DISTRICT COURT 


SOUTHERN DISTRIC'' OF NEW YORK 


COPY 


70 Civ. 4141 (MP) 


Ce eee eee eee mmaenanennena lana amines Net, 


BOSTON M. CHANCE, LOUIS C. MERCADO, 
et al., 


Plaintiffs, 


Vv. . 


THE BOARD OF EXAMINERS AND THE BOARD OF 
EDUCATION OF THE CITY OF NEW YORK, 


et al., : 
i Defendants, : oo 
a eee Y 


COUNCIL OF SUPERVISORS AND ADMINISTRA-— 
TORS OF THE CITY OF NEW YORK, LOCAL 1 : 
SASOC, AFL-CIO, 


Defendant-Intervenor. 


Opinuror et 


APPEARANCES: 
Attorneys for Plaintiffs: 
Elizabeth b. Dubois, Esq. 
(Legal Action Center of the City of New Yorx, Inc.) 
271 Madison Avenue 
New York, N.Y. 10016 


‘George Cooper, Esq. 
435 West l1i6th Street 
New York, N.Y. 10027 


Jack Greenberg, Esq. 
10 Columbus Circle 
New York, N.Y. 10027 


Jeanne R. Silver, Esq. 
20 West 40th Street 
New York, N.Y. 10018 


oe 
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APPEARANCES : 


W. BERNARD RICHLAND 
Corporation Counsel of the City of New York 
(Attorney for Defcndant Board of Education) 
Municipal Building 
New York, N.Y. 10007 
By: Leonard Bernikow, Fsq. and 

Flliot P. Hoffman, Esq. of Counsei 


KAYE, SCHOLER, FIERMAN, HAYS & HANDLER 
(Attorneys for Defendant Board of Examiners) 
425 Park Avenue 
: New York, N.Y. 10022 
By: Howard A. Jacobson, Esq. and 
Robert S. Ellenport, Esq. 


FRANKLE & GREENWALD 
(Attorneys for Intervenor-—Defendant Council of 
Supervisors & Admi>istrators of the City of 
New York, Local 1, 3ASOC-AFL-CIO) 
80 Eighth Avenue 
New York, N.Y. 10011 
By: Max H. Frankle, Esq., 
Leonard Greenwald, Esq., and 
Gretchen White Oberman, Esq. of Counsel 


MILTON POLLACK, District 


MILTON POLLACK, District Judge. 
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This is the latest installment in an extensive pending 


litigation which has consumed the energies of the federal courts 


for nearly six years. The defendant Board of Education (here- 


after, the "Board") secks a reconsideration of an ordcr herein 
dated April 4, 1975 by former Judge Harold R. Tyler of this 


Court (now Deputy Attorney General of the United States) which 


ruled that plaintiffs were entitled to an award of attorneys' 
fees to be fixed herein for successful services rendered in 
this suit. The defendant Board relies on the Supreme court's 
recent decision in Alyeska Pipeline Service Co. v. Wilderness 
Society, 421 U.S. 240 (1975) for an order setting aside Judge 
Tyler's order and denying a fee award to the plaintiffs. In 
‘ response, plaintiffs have cross-moved for leave to amend 

‘ their complaint to add an additional ground for the allowance 
ef fees, not previously available nor asserted heretofore. 
The Board has countered by objecting to the proposed amendment 
and has filed a motion challenging the sufficiency of the adai- 
tional claim proposed. 

Reconsideration of Judge Tyler's order is granted and 
upon such reconsideration this Court finds that the ruling 
should be adhered to for the reasons which appear hereafter. 
Plaintiffs’ motion to amend the original complaint will be 
denied, however; and accordingly, the Board's motion challeng- 
ing the sufficiency of the proposed amendment will be dis- 


missed as moot. 
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This civil rights class action, brought under 
42 U.S.C. §§ 1981, 1983, challenged the examinations used 
to select principals and other supervisors in the New 
York City school system on the ground that the examina- 
tions discriminated against minority groups in violation 
of the Fourteenth Amendment. Extensive negotiations and 
court proceedings produced a consent “judgment entered 
against the defendant Board of Examiners (hereafter, 
“Examiners") on July 12, 1973 and against the Board on 
March 25, 1975. The judgment prohibited the use of the 
challenged examinations, established an interim system 
for the selection of supervisors, and ordered the develop- 
ment of a permanent selection system based on non-discrim- 
inatory job-related examinations. A more detailed discus- 
sion of the suit may be found in Chance v. Board of 
Examiners, 458 F.2d 1167 (2d Cir. 1974). Subsequent 
proceedings in the case have focused on the effects of 
the judgment on an existing collective bargaining agreement 
between the Board and the Council of Supervisors and 
Administrators, intervenor-defendant, (hereafter, the "CSA") 


and on the Board's plan to "excess" supervisory personnel 


a 
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from climinated positions on a "“last-hired, first-fired" 
basis. As to the latter issuc, the Court of Appeals has 
recently reversed an order of the District Court (Tyler, J.) 
which imposed racial quotas on the excessing process. 

Chance v. Board of Examiners, Civ. No. 75-7161, 7164, 

(24 Cir., January 19, 1976). 

In his decision of April 4, 1975, Judge Tyler evaluat- 
ed several distinct grounds for an award of counsel fees 
asserted by the plaintiffs and veuted his decision on an 
"analogy to Title VII [of the Civil Rights Act of 1964] 
and on the private attorney general theory." Chance v. 
Board of Examirers, Civ. No. 70-4141(HRT) (S.D.N.Y., 

April 4, 1975). The Board contends here that the decision 
of the Supreme Court in Alyeska Pipeline Service Co. v. 
Wilderness Society, 421 U.S. 240 (1975), prohibits the 
award of attorneys' fees to plaintiffs in such cases, in 
the absence of specific statutory authorization for such 
relief and contends further that there is no such statutory 
authority here. Judge Tyler's reliance on the private 
attorney general theory rested in part on an award on that 
ground male by a District Court. However, that decision 
has subsequently been reversed by the Second Circuit 

on the authority of 
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Alyeska. Kirkland v. New York flate Department of Correc- 


tional Services, 520 .2a 420, 430 (2d Cir. 1975). 


—— 


The question this Court must decide on this motion 
for Oe chupattec: therefore, is whether there isa 
“specific and explicit" statutory provison for the allow- 
ance of counsel fees to the plaintiffs in this case. 
Alyeska, supra, at 260. The plaintiffs contend that there 
are two such statutes. By moving to amend their complaint 
to allege a claim under Title VII, 42 U.S.C. § 2000e, 
they seek to render applicable that statute's authoriza- 
tion of an award of attorneys’ fees to the prevailing 
party in a suit brought under that Title. 42 U.S.C. 

§ 20003-5(k). They also contend that, independently of 
an amended Title VII complaint, they are entitled to 

counsel fees by virtue of § 718 of the Emergency School 
Aid Act, 20 U.S.C. § 1617. The defendants contend that 


the latter statute is inapplicable to the present law 


suit, and that the motion to amend the complaint to 


assert a Title VII claim may not be properly granted at 


this stage of the litigation. 
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B. Title Vil 

Plaintiffs could not have alleged a Title VII 
claim when they first brought their action in 1970, since 
at that time the statute exempted state and local govern- 
ment agencies from its coverage. This exemption was 
deleted, however, effective March 24, 1972. Equal Employ- 
ment Opportunity Act of 1972, Pub. L. No. 92-261, § 2, 

86 Stat. 103. 

While plaintiffs contend that a denial of their 
motion to amend the complaint at this time would exalt 
form over substance, it appears to be they who are seeking 
to do just that. The attorneys' fees provision of Title 
VII authorizes the award of such fees to the prevailing 
party "({i]n any action or proceeding under this sub- 
chapter." The plaintiffs concede that they now wish 
to amend their complaint to state a Title VII claim for 
"the sole and only purpose” of clarifying their right to 
counsel fees; they do not seek any substantive relief 
under Title VII. Indeed, they could not do so, for the 
ets inestes ane enjoined in the consent judgment Of duly i2, 
1973 from asserting any new claims "which might have been 


asserted against the defendants" in connection with the 


— 
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Title VII and §§ 1981 and 1983 ar2 “independen([t] 
avenues of relief" which are "separate, {and] distinct.” 
Johnson v. Railway Express Agency, Inc., 421 U.S. 454, 
460-61 (1975). By limiting the purpose of their proposed 
Title VII claim to the recovery of attorneys' fees, 
plaintiffs are clearly seeking such fees under Title VII 
for litigation in which substantive relief was granted 
under §§ 1981 and 1983. Yet that is precisely what 
Alyeska and Kirkland, supra, determined to be improper. 
Accordingly, the plaintiffs’ motion to amend the complaint 
should be denied. Any analysis to the contrary in the 
original opinion awarding fees in this case may not with- 
stand the teaching of those subsequent cases. 

Moreover, plaintiffs have failed to com, y with 
the variety of procedural requirements, involving a prelim- 
inary resort to the Equal Employment Opportunity Commission, 
which are "jurisdictional" prerequisites of maintenance 
of a civil action under Title VII in the federal courts. 
See Delatteis v. Eastman Kodak Co., 511 F.2d 306 (2d cir.) 


modified on other grounds, 520 ¥.24 409 (24 Cir. 1975). 
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It is true that a failure to observe such requirements 


may be excused in some circumstances, since the law does 
not require that plaintiffs engage in a “futile ceremony" 
or participate ina “charade.” . Figueiredo v.- TWA, 

322 F. Supp. 1384, 4367-96 (6.D.N.¥. 1973)3 Weise v. 
Syracuse University, Civ. No. 9421977 (24 Cir., July 14, 
1975). If plaintiffs sought some substantive relief 

under Title VII, therefore, it is possible that their 
failure to invoke the conciliation process of the EEOC 
would be overlooked in view of the fact that plaintiffs’ 
litigation had long since been underway when Title VII 
first became available to them. That is not the case 
however; instead, plaintiffs are seeking the benefits 

of some of Title VII's procedures -- the authorization of 
counsel fees -- without having borne the burdens of the 
others. If there is any "charade" here, it is one pro- 
posed by plaintiffs. In these circumstances, there 
appears to be no compelling reason for the Court to excuse 
plaintiffs’ failure to comply with the statutory scheme. 
c. 20 U.S.C. § 1617 


Section 718 of the Emergency School Aid Act, 


20 U.S.C. § 1617, provides that: 
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Upon the entry of a final order by a court of 
the United States against a local educational 
agency, a State (or any agency thereof) ... for 
failure to comply with ... the fourteenth amend- 
ment to the Constitution of the United States 
as [{it) pertain[s] to elementary and secondary 
education, the court, in its discretion, twpon a 
finding that the proceedings were necessary to 
bring about compliance, may allow the prevailing 
party, other than the United States, a reason- 
able attorney's fee as part of the costs. 


i 
| 
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Since plaintiffs' suit sought to redress a violation of 
the Fourteenth Amendment and was brought "for the purpose 
of correcting an underrepresentation of minorities in 


supervisory positions in the New York City school system," 


"eae. Se A RR a AE a GRICE AREPE cere te 


Chance, supra, Ci ). 7ee7161 (24:Cir., dan. 19, if76i, 


i sear 


§ 1617 appears applicable. 

Nonetheless, the defendant Board of Education contends 
that this litigation does not "pertain to ... education" 
in the sense Congress intended in enacting § 1617. The 
Board argucs that Congress was primarily interested in 
actions to promote desegregation of schools, not suits 
against discrimination in employment by defendants who 
happen to operate educational facilities. Authorization 
for counsel fees in such employment suits, the Board alleges, 


is within the exclusive province of Title VII. 


2. 
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It is true that many of the decisions granting 


counsel fees under § 1617 invelve desegrcyation. See, 
e.g., United States v. Board of School Commissioners, 
503 F.2d 68 (7th Cir. 1974), cert. denied, 421 U.S. 929 
(1975); Brewer v. School Board, 500 F.2d 1129 (4th Cir. 
1S'4); Medley v. School Board, 482 F.2d 1061 (4th Cir. 
1973), cert. denied, 414 U.S. 1172 (1974). However, the 
Board concedes, as it must,that counsel fees have also 
been awarded under § 1617 to acre and school super- 
visory personnel who have been discriminated against in 
regard to hiring, firing, and promotion. Nonetheless, 
the Board argues that such awards have been made only 
where the challenged employment practice was incident to 
the implementation of a desegregation plan, and were thus 


consistent with the Board's restrictive view of § 1617. 


Bee, e.g., Ward v. Kelly, 515 ©.2a 908, (Sth Cir. 1975); 


Thompson v. Madison County Board cf Education, 496 F.2d 


652 (Sth Cir. 1974); Jackson v. Wheatley School District 


No. 28, 489 F.2d 608 (8th Cir. 1973) (Judge Moore of the 


2a Circuit sitting by designation). 
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Even if that were the case, however, there sccms 


little reason to distinguish among employment discrimina- 
tion suits by teachers and principals on the basis that 
some follow on the heels of desegregation of a school 
district, and others do not. In Armstead v. Starkville 
Municipal Separate School District, 395 F. Supp. 304 
(N.D. Miss. 1975), for example, attorneys' fees were 
awarded under § 1617 in an employment discrimination case 
brought by teachers on facts which wére very similar to 
those in Chance. The plaintiffs challenged the schowl 


board's policy of retaining only those teachers who 


achieved a certain minimum score on the Graduate Record 
Examination. The District Court found that the examina- 
tion was not job related and had a racially discriminatory 
effect. Althcugh the teachers' suit did follow a de- 
segregation order, there is nothing in the text of § 1617 
which would justify an award in Armstead but a denial in 
Chance. 

It is bonccivenie that an employment discrimination 


suit brought by a single individual school employee might 


have insufficient impact on the educational process to 
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warrant the application of § 1617. However, a suit 


properly brought as a class action by teachers or 
principals inevitably has a substantial effect on the 
representation of minorities in important roles in the 
schools, and therefore would appear to fall within the 
ambit of the statute. See Morton v. Charles County 
Board of Education, 373 F. Supp. 394 (D. Md. 1974) (fees 
awarded under § 1617 in employment discrimination suit 
by single principal where litigation helped eliminate 
racially identifiable faculty); Aspira of New York, Inc. 
Vv. Board of Education, 65 P.R. 0.541 (S.D.N.¥%. 1975) (fees 
awarded for suit challenging lack of bi-lingual school 
instruction; limitation of § 1617 to desegregation suits 
expressly rejected). 

Since neither the text of the statute Gar the 
precedents which have applied it suggest that the instant 
case should be excluded from its coverage, the narrow 
construction of § 1617 favored uF the defendant Board 
should be sustained only if it is compelled by the legisla- 
tive history, as the Board contends. The provision had 
its genesis as § 11 of S. 1557, 92d Cong., 1st Sess. 


(1971), a bill which was in large part enacted into law 
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as part of the Education Amendments of 1972. While there 


was considerable discussion and analysis of § 11 by the 
Congress to which this Court may look for guidance in 


the interpretation of § 1617, it is far from conclusive, 


and in any event, does not sustain the position adopted 


by the defendant Board. 

The attorneys' fees provision was included as a 
part of a legislative proposal to provide financial 
assistance to school districts which were involved in 
the desegregation process. Hence, much of the floor 
debate on the amendments which were made in the Senate 


to delete the provision and then restore it in modified 


is Section 1617 was enacted as § 718 of the Emergency 
School Aid Act, which in turn was approved by Congress 
as part of the Education Amendments of 1972, Pub. L. No. 
92-318, 86 Stat. 235. There was apparently no discussion 
of the attorneys' fees provision on the floor of either 
House of Congress when the measure was passed in the 
spring of 1972, and the committee reports are similarly 
Gevoid of analysis, H. Rep. 92-554, 92d Cong., lst 

Sess. (1971), S. Rep. 92-604, 92d Cong., 2d Sess. (1972). 
The report of the conference committee does describe 

the provision, but sheds no light on the issue before 
the Court. ' S. Conf. Rep. 92-798, 92d Cong., 2d Sess. 
(1972). 
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form concerned its application in school desegregation 
2 
suits. Nevertheless, there is no indication that the 


senators intended the provision to be limited to such 
suits. Indeed, one senator based his opposition to the 
provision in part on the ground that it “contains no 
language to control the kinds of suits brought by private 
attorneys" and "fails to control or delineate the scope 
of coverage." S. Rep. 92-61, 92d Cong., Ist Sess. (1971) 
at 61-63 (individual views of Mr. Dominick). Another 


senator who supported the measure explained that 


OL, 


2/ As reported from the Senate Committee, § 11 of S. 1657 
provided for attorneys' fees to be awarded to plaintiffs 
in language almost identical to that enacted in § 1617; 
however, it also provided that such fees would be paid 

by the federal government, not the defendant school 
boards, and it authorized a fund of $15-million to 
accomplish that purpose. The Senate passed an amendme?.t 
to delete § 11 entirely on April 21, 1971, 117 Cong. 
Rec. 11345 (1971), but restored it two days later 

without the provision for federal funding of counsel fees, 
117 Cong. Rec. 13726 (1971). 


An analagous >ttorneys! fees provision was also 
included in H.R. 2266, the House counterpart to S. 1557, 
which was reported from the House committce on October 19, 
1971. While eventually enacted as part of the Education 
Amendments of 1972, that bill was initially defeated by 
the House on November 1, 1971 after a debate in which 
the attorneys’ fec provision played a minor role. 

117 Cong. Rec. 38493 (1971). 
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This amendment says ae very simple thing. It 
Says that if it is necessary to bring an action 
by reason of the violation of ... the fourteenth 
amendment to the Constitution of the United 
States.... the school board should be compelled 
to pay those attorney's fees and costs.... 

117 Cong. Rec. 11527-28 (1971) (remarks of 

Sen. Cook). 


Finally, tne report on S. 1557 of the Senate Committee 
on Labor and Public Welfare, ihe most reliable source of 
¢ongressicnal intent on the measure, indicated that the 


provision was designed to insure "vigorous nation-wide 


. 


enforcement of Constitutional and statutory protection 


against all forms of discrimination based upon race, 
color and national origin in elementary and secondary 
education." S. Rep. 92-61, 92d Cong., lst Sess. (1971) 
at 25 (emphasis added). Thus, while the primary purpose 
for the enactment of § 1617 may have been to allow the 
award of attorneys' fees in school desegregation cases, 


it is clear that Congress did not intend to limit the 
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application of the provision to such suits. 

Under this interpretation of the statute, the 
plaintiffs are entitled to a reasonable attorncys.' fee. 
The defendants Board and Examiners are local educational 
agencies and state agencies, and the consent judgment 
constitutes a final order against them which arose from 
their failure to comply with the Fourteenth Amendment as 


it pertains to elementary and secondary education. 


3/ The defendant Board of Education notes that § 1617 
was enacted in 1972 some three months after Title VII 
of the Civil Rights Act was amended to extend its cover- 
age to employees of government agencies and educational 
institutions. It contends that the award of attorneys’ 
fees in employment discrimination suits against schools 
was therefore already authorized prior to the passage 
of § 1617, and that Congress should not be deemed to 
have legislated redundantly. Accordingly, the Board 
argues that the timing of the two statutes supports its 
restrictive reading of § 1617. : 


The Board overlooks that at the time each measure 
was reported from committee -- and the committee report 
is the most reliable indicium of congressional intent -- 
neither had been enacted into law, and that, in fact, 
the predecessor of § 1617 had already passed the Senate 
before the rclevant Title VII amendments were first 
reported from committee in the 92a Congress. 117 Cong. 
Rec. 11726 (April 23, 1971) (Senate approves attorneys" 
fees amendment to S. 1557); H. Rep. 92-238, 92d Cong., 
lst Sess. (June 2, 1971) (first committee report in 
92d Cong. on Title VII amendments). 
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Court proceedings were necessary to bring about that 


compliance. While § 1617 provides that an award remains 
in the discretion of the Court even where all these 
criteria are met, the Supreme Court has established 

that the allowance is essentially automatic “'unless 
special circumstances would render such an award Unjust. | 
Northcross v. Board of Education, 412 U.S. 427, 428 (1973). 
No adverse special circumstances have been brought to 

the Court's attention in this case. There is no ques- 
tion that § 1617 authorizes the award of fees for work 
which antedated its enactment, where the fee application 
had not been finally determined prior to that date. 
Bradley v. School Board, 415 U.S. 696 (1974). 

Defendants are liable to the plaintiffs for counsel 
fees only in connection with the matters on which they 
prevailed in the litigation. Plaintiffs produced the 
consent judgment against the defendants Board and 
Examiners, and procured the clarification of that judg- 
ment in regard to the filling of supervisory vacancies 
by the transfer of other personnel. Chance v. Board of 


Examiners, Civ. No. 70-4141 (WRM), 7 Imp. Prac. Dec. 
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gq 9084 (S.D.N.Y., Dec. 27, 1973). Plaintiffs have not 


prevailed in regard to the excessing issuc. 

Finally, it is necessary to clarify the liability 
of the intervenor-defendant CSA for plaintiffs’ counsel 
fees. CSA has acted in the role of amicus curiac through- 
out most of this litigation, in part because plaintiffs 
“strenuously resisted," as the plaintiffs phrase it, 

CSA's several motions to intervene. Plaintiffs may not 


now turn around and assert iiability against CSA as if 


it had been an intervenor from the onset of the litigation. 


Plaintiffs have cited no authority for an award of 
attorneys' fees against an amicus curiae, and this Court 
will provide none. 

Moreover, CSA may not be held liable for attorneys’ 
fees to plaintiffs for the brief period during which CSA 
was granted intervenor status and plaintiffs were the 
prevailing parties, for § 1617 does not authorize such 
liability. While the statute may not speak precisely to 
the issue, it is apparent that it authorizes the award 
of fees against local educational and state agencies, not 


against private parties. See McCrary v. Runyon, 515 F.2d 
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ee 


573a 
1082, 1090 (4th Cir.), cert. granted, 44 U.S.L.W. 3271 


(Nov. 11, 1975). Although fees were awarded against a 
city council under § 1617 in Northcross v. Board of 
Education, 489 F.2d 19 (6th Cir. 1973), cert. denied, 
416 U.S. 962 (1974), the Sixth Circuit Court of Appeals 
had authority for that award independent of § 1617, and 
the city council there had acted to prevent the local 
educational authority from complying with the lawful 
orders of the Court. 

The motion of defendant Board of Education to 
strike the award heretofore made of attorneys' fees to 
plaintiffs is thus denied. The plaintiffs' motion to 
amend the complaint is denied, and the cross-motion of 
defendant Board of Education to dismiss the amended 
complaint is moot. A reasonable fee for plaintiffs’ 
attorneys will be determined and awarded herein upon 
an evidentiary hearing of the relevant facts. Plaintiffs’ 
application therefor, fully documented, should he 
completed and served on defendants who may have document- 
ary discovery and take any desired appropriate deposi- 
tions upon informal notice and request therefor, the 


same to be completed within 60 days hereof. The date 
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for the hearing will be fixed upon advice to the Court 


that the parties are ready to proceed therewith. 


So ordered. 


Milton Pollack 
U.S. District Judge 


February 11, 1976 
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Honorable idilton Pollack 
United States District Judge 
U.S. Court House : 
Foley Square 

New York, New York 


Re: Chance v. Board of Examiners 
Dear Judge Pollack: 


We have received a copy of a letter to this Court 
dated April 2, 1976 from counsel to the Board of Education 
requesting a further extension of time within which to file 
a movion to modify the Consent Judgment herein. On behalf 
of cur client, the Board of Examiners, we vigorously oppose 
further delay in this case and, pursuant to your rules, 
seez permission of this Court to move formally for the 
entry of an order requiring the immediate implementation of 
the Consent Judgment. 


A review of the facts is revealing. On May 24, 
1974 all parties herein jointly submitted to this Court a 
Plan for new comprehensive examinations for supervisory 
personnel in the New York City school system. That Plan 
nad deen jointly ‘developed and agreed to by ail parties -- 
with the exception of two issues, which are not here in 
diszute and which the parties agreed to submit to this Court 
Zor resolution. 


t @ hearing on January 14, 1975, Judge Tyler 

ved the Plan. The two oven issues were thereafter 
Sirally resolved and on March 25, 1975 an order was entered 
ily incorporating the Plan within the Consent Judgment. 


Tnus, the Plan was jointly developed by all the 
yar. .es herein, its contents (with two exceptions not at 
“$£32 here) have been known to all parties since May 1974, 
this Court apcroved the Plan in January 1975 and the Plan 
has deen formally part of the Consent Judgment since March 
1973. : 
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The Plan calls for the initial develonment of three 
protot;ve examinations for three prototypical sunervisory 
positions. The first step in the creation of those three 
crototype examinations is the development of job analyses for 
shose positions by the Board of Education utilizing A.I.R., 
an independent consulting firm. 


Well prior to the entry of the March 25, 1975 order, 
the 3oard of Education had already chosen a consulting firm 
to create those job analyses and, to our knowledge, a contract 
vetween the Board of Education and that firm had already been 
Signed. Yet, to date, the Board of Education has not come 
rorviard with job analyses acceptable to it. Since the Plan 

s that the three prototype examinations should be 
ped from the job analyses the Board of Education's 
nas the effect of delaying the Board of Examiners' 
to develop the examinations themselves utilizing its 
ing firm.* 


It was because of the Board of Education's prolonged 
ay Chat the Board of Examiners sought a pre-motion confer- 
with this Court, in accordance with its rules. At that 
confere nee, which was held on January 22, 1976, counsel for 
che Board of Education pleaded for additional time to carry 
out its responsibilities under the Plan with respect to the 
sob analyses. At no time during that conference was there 
any suszestion that “she Board of Education wished to modify 
that Judgment in any way. In fact, Michael Rosen, Esq., 
counsel to the Chancellor of the City School District, 
expressly stated that the Board of Education intended to 
carry cut its resconsibilities under the Plan. Accordingly, 
eltnousn this Court indicated that the Board of Education's 
orduct appeared to be contumacious, it agreed to 2 six-week 
edjcurnment of the ore-motion conference until March 4, 1976 
“nas the Board c. Education could fulfill its responsibilities 
fm respect to the job analses. 


# jo the end of gune 1975 tne Board of Education entered 
a contract with Development Dimensions Inc., whereby 
Firm is te develop tne prototype examinations for 
Board of Examtners. Partial payment has already been 
made to Develorment Dimensions Ine. under that contract. 


KAYE, SCHOLER, FIERMAN, HAYS & HANDLER 


At the adjourned conference, on March 4, counsel 
r tne Board of Education explained that it had rejected 
2 jco analyses which had been created by its consultants, 
G announced , for the first time, that it wished to move 
so modify the Plan which is vart of the Consent Judgment. 
The 30ard of Education's counsel also stated that it and 
plain ziffs' counsel were in the midst of meetings with 


reszsect to such @ modification and, for that reason, ex- 
GCressed reluctance to- discuss details of it Over our 
objections, this Court deferred action on the Board of 
Exeminers' motion to implement the Consent Judgment and 
adorted a schedule for the Board of Education's motion to 
modify the Judgment whereby the Boarc of Education would 
serve its motion by March 18, opposing papers would be 
served by Avril 1, and a hearing date would then be scheduled 
for sometime during this month of April. This Court also 
aoa indicated that if it denied the Board of Education's motion 
? vO modify the Consent Judgment, it would *eél free to enter 
ca Sucn orders as misht be necessary to require immediate 
, amcolementation of that Judgment. 


Therearzer, the Board of Examiners consented to 
4 cne-veek extension of the Board of Education's time to 
maze its motion until March 25 because the Board of Educa- 
zien wished to meet with the Board of Examiners to see 
whnetner an agreement could be reached between them. The 
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Exeminers met witn the Board of Education and found the 


Bozrd of Education's proposal to be totally unacceptable. 
dowever, the Examiners did make suggestions aimed at satis- 
fying what they tnought were the Board of Education's con- 


cer:.s. The Examiners agreed to a second one-week extension 


Of Cne Board of Sducation's time, to’ April 1, because the 
Zoer4 cf Education's counsel claimed that they needed that 
wile to eC€omDlete Their motion papers. 


Incredicly, after the April 1 date has come and 
2ne S29ard oF Education's counsel now seek another 
S520n OF Ghelr Cime to make their motion, this time 
2a5t until Anril 9th, 1976" and, as their current 
for the receated delay, the Board of Education now 
“O NMecotla sons with slaintifis about thelr motion. 


: Thus, sinee we brourht the Board of Education's 
GcrGiat under Che Consent Judgment to this Court's atten- 
tion in January 1976, the Board of Education has obtained 
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a series of delays in carrying out its responsibilities 
under that Judgment: first, to March |, in order to act 

on the job analyses; second, to March 18, to move to 

moaify the Judgement; third, to Mareh 25, to meet With the 

Board of Examiners; and fourth, to April 1, to complete 

its motion papers. Now, the Board of Education seeks 
further time allesedly because of meetings with plaintiffs' 
counsel. 


The Board of Examiners is concerned about this 
pattern of delay in implementing the plenary supervisory 
examinations contemplated by the Consent Judgment and long 
awaited by the New York City educational community, as well 
as oy both this Court and the Court of Appeals for the 


Second Circuit. It believes it to be imperative that prompt 
action be taken so that development of examinations can 
bezin before the end of the current school year -- only 


ebouc 10 weexs away. 


In view of the extraordinary delay to date, we 


nereby seek permission of this Court on behalf of the Board 
of Examiners to file a formal motion to implement the Con- 
sent Judgment. Since the Board of Education has demonstrated 
shet it is unwilling to adorst satisfactory job analyses in 
accordance with tne Plan which is part of the Judgment, the 
Sxeniners should be authorized by this Court to prepare 
such analyses themselves pursuant to the Plan utilizing its 
4ndesendent consulting firm. 
Respectfully yours, 
/ . 
WV LLC i Av kha 

HAC+ ak Hotiard” Ki eats 
ne: Devoran Rothman, Esq. Sa 

Jeanne BR. Silver Frankl, Esq. 

Sligaboth B. Dubois, Ese 
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Board of Education's Notice of Motion (with 

exhibit) dated April 9, 1976, together with 

supporting affidavit of Robert Christen (plus 
exhibits), sworn to April 12, 1976 


UNIVED SGATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE, et al., 
Plaintiff, 


-against~ 


THE BOARD OF EXAHINERS, et al. 


Defendants. 
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NOTICE OF MOTION 


Index No. 
WU Civ. 424) 
(Mids .) 


PLEASE TAKE NOTICE, that upon the annexed affidavit of 


Robert Christen, sworn to April /2 , 1976, and upon the pleadings 


and all other papers and proceedings had herein, and pursuant to 


Paragraph V of this Court's Order Modifying Final Judgment and 


Order, entered against all defendants, March 25, 1975 (hereinafter 


the "March 25, 1975 Order") and paragraph XIV of the Final Judgment 


herein against defendant Board of Examiners, its members, and 


defendant Chancellor of the City School District of the Cl On 


New York, entered on July 12 


, 2973, and paragraph XIV of an 


Order containing similar terms which modified the preliminary 


injunction previously issued against the Board of Education, its 


members and the Chancellor of the City School District, entered on 


duly) 12 


. 1973, both of which were incorporated in the afore- 


Said March 25, 1975 Order, defendants Board of Education and 


Chancellor will move this Court, at the United States Courthouse, 


Foley Square, New York, New York on a date to be determined by the 


Court for an Order: 


1. Approving the modified Plan for licensing and selectins 


Supervisors in the New York City school system annexed hereto 


as Exhibit "1" and permitting the defenéants to Cevelop a new 


supervisory selection and licensing system in accordance with 


this modified Plan. 


2. Modifying said March 25, 1975 Order by: 


a. Strikin 


referred to therein; 


Paragraph VI thereof together with the Plan 


582a 
b. amending the reporting provisions contained in the 


introductory paragraph and Subparagraphs A-D of paragraph 
VII of the March 25, 1975 Order by deleting them in their 
entirety and substituting therefor the provisions 
included in section VI of the Plan annexed as Exhibit "1" 
hereto. 
3. Providing that, except to the extent inconsistent herewitr, 
the provisions of the March 25, 1975 Order shall continue in 
full force and effect against all the defendants. 
4. Granting such other and further relief as to the Court 


may seem just and proper. 


‘Dated: New York, New York 
April |, 1976 


W. BERNARD RICHLAND 
CORPORATION COUNCIL 
Attorney for Defendants 
The Board of Education. and 
Chancellor 


Dade Fe. 


Deborah Rothman 
Assistant 
Corporation Council 


By 


: Municipal Building 
New York, New York 10001 
(212) 566-2186/2192 


Plan for Licensing and Selecting Supervisors 
in the New York City School System 583a 


Introduction & Summary 


This Plan provides for the development of “open qualifying" 
examinations by the Board of Examiners in fulfillment of its 
statutory responsibility to provide examinations for the 
licensing of supervisors on the basis of "merit and fitness.” 


The Plan also describes adaptations of appointment procedures 
that have been developed by the Board of Education which will 
be coordinated with the new licensing process to effect a non- 
. discriminatory, job-related process of qualifying and selecting 


supervisory personnel. 
The fundamental goal of this Plan is to develop a valid, 


job-related selection system, consistent with the requirements 

of Title VII of the 1964 Civil Rights Act, as amended, and 

of the United States Constitution. 

The premise of this Plan is that the new supervisory 

selection system must be characterized by two main features: 
1) The use of qualifying procedures which facilitate 
entry by diversely talented and experienced individuals 
into competition for supervisory appointments; and 


2) The use of on-the-job evaluation as a basis for 
determining permanent licensure. 


Additional considerations are that qualifying procedures must be 
Practica] and economical, on-the-job evaluations must be developed 
and implemented respectively by the authorities best capable of 
fulfilling each function, and all procedures must be designed 

and administered to obviate discriminatory exclusion of applicants 
for failing to meet non-job related requirements. 

To achieve these goals, the Plan provides for a two-step 
licensing and selection process. Provisional licensure based upon 
an unassembled open qualifying examination, will be a pre-condition 
to placement on eligible lists and initial appointment. All persons 
placed on eligible lists must possess the experience and education 


requirements for state certification. Selection for such 


appointments shall be made by appointing authorities from 


“Exhibic 1" 


ade 
' 584a 
among individuals on eligible lists based upon the information 


furnished by the Board of Examiners and pursuant to selection 
procedures conducted in accordance with requirements established 
by the Chancellor. Following one year of provisional savvics, 
candidates will be evaluated by the appointing authorities and 
decisions as to whether or not they shall be permanently licensed 
shall be made based upon their on-the-job performance. | 
Additional provisions are set forth in the Plan to assure | 
that it will be open and non-discriminatory, and capable of speedy 
implemention, as well as to facilitate transition from the current 
interim system. 
I. New Licensing and Selection Procedures 
Each of the Plan's two phases--provisional licensure and 


selection, and permanent licensure and appointment--cngages the 


full resources of the system to assure high quality in licensing 


and selection. 
A. Phase l 

Provisional Licensure. 

The provisional phase starts with an open quelifying examina- 
tion using a profile resume application (P.R.A.) technique. The 
Board of “xaminers will determine candidates’ compliance with 
training, experience and other requirements established by the 
Chancellor pursuant to State Law. This examination, an unassembled 
examination to be developed and administered by the Board of 
Examiners, will consist of a review, verification and analysis 
of record. The Board of Examiners will establish procedures by 
which candidates may document their training and experience. On 
the basis ¢f an evaluation of this material, as well as any other 
inquiries appropriate to verify transcripts and resumes, the Board 
of Examiners will determine which applicants are qualified and 
therefore eligible for placement on an eligible list and for 
provisional licensure. 

Candidates will also be required to participate in a written 
essay examination developed by the Board of Examiners and admini- 


stered under proctored examination conditions by the Board of 
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‘ 
Examin2rs. The essay will be destined to demonstrate skills in 


written expression about matters relating to the position for whic: 


application is made, and the Board of Examiners will evaluate and 


comment on the candidates' written communication skills. 


The Board of Examiners will develop profiles of each candi- 


date on the eligible list. The profile will contain the candidate's 


record and written essay, and the Board's reviews and analyses 
thereof. These profiles shall be made available to all appointing 
authorities to which applicants wish to apply for positions. 
Provisional Appointment. Selection by appointing authorities 
is a crucial second step in Phase 1. Safeguards comparable to 
those developed by the Chancellor during the interim period, under 
so-called Special Circular 30 procedures, will be continued and 
will be strengthened. These have required appointing authorities 
to institute uniform non-discriminatory selection procedures, 
affording adequate notice to applicants, and involving parents and 
professionals in a deliberative process subject to review. At 
present, a monitoring task force from the Board of Education's 
Division of Personnel supervises the selection process in order 
to insure such uniform non-discriminatory selection procedures. 
Under the new Plan, the authorities will be assisted in their 
assessments of individual qualifications by the profiles. Based 
on these assessments, provisionally licensed individuals may be 


appointed to fill vacancies for provisional periods of one year. 


B. Phase 2 


Permanent Licensure. On-the-job performance evaluations 
leading to permanent licensure will be made by appointing 
authorities of persons who have been retained for the entire pro- 
visional year of service. The appointing authorities will use a 
uniform rating and evaluation form developed by the Chancellor in 


conjunction with the other appointing authorities to assure that 


evaluations are based upon uniform standards and criteria and actual 


requirements for successful performance on the job. Upon completion 


of on-the-job evaluations, appointing authorities shall certify to the 
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Board of Education whether or not candidates have met the per- 


formance requirements. Applicants who meet such requirements 
will be issued permanent licenses. 

Permanent Appointment. Permanently licensed individuals 
will be eligible for appointment by any appointing authority for 


the probationary period established by State law. 


il Initiation of the New System 
The new system will be effectuated immediately on a schedule 


responsive to current needs. As soon as practicable after the 
effective date of this Order, the Chancellor will review all 
titles of supervisory posicions for which licenses have been 
established and the minimum training and experience requirements 
therefor, and shall order the Board of Examiners to commence Phase 1 
examinations starting with those three positions in which the most 
vacancies exist. 

Phase 1 examinations shall thereafter be administered and 
the first eligible lists promulgated for each title as promptly 


as administratively feasible. 


Iil Frequency of Step 1 Examinations and Establishment of 
Eligible Lists for Persons with Provisional Licenses 


Tne Plan is responsive to the parties’ long standing concern 
to maximize the opportunity for qualified minority applicants to 
compete for supervisory positions. Once an eligible list is 
established in regard to a particular title, Phase 1 examinations 
shali continue to be administered and names added to eligible 
lists on an ongoing, continuing basis so that applications may 
be submitted at any time and no more than 90 days may intervene 
between an application and determination of eligibility for pro- 
visional licensure. Successful candidates for provisiona) licensure 


shall have their names added to eligible lists and shall remain 


on such lists for a period of four years. 


“a 
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Iv Phasing Out of Interim System of Assignment and Licensing 
A. Assignment and Appointment: 


The interim system of assigning licensed or unlicensed per- 
sonnel to fill vacancies established by the Final Judgment and 
Order of July 12, 1973, shall continue with respect to a partic- 
ular title, until the first new eligible list for such title is 
established and the first provisional licenses therefor issued, 
at which time it will terminate with respect to that title. 

From that time on, appointing authorities shall be free to fil) 
supervisory vacancies in such title with persons who possess such 
provisional licenses or with persons who possess licenses granted 
pursuant to the interim system of performance evaluation or with 
persons who possess licenses granted pursuant to the previous 
System of examination. Notwithstanding the foregoing, any un- 
licensed person serving pursuant to a valid assignment in accor- 
dance with the interim assignment system at the time such system 
terminates with respect to the title in which he is serving, 

may be continued in employment by the appointing authority pending 
permanent licensure pursuant to the provisions of paragraph B 
below, and any such individual whose application for on-the-job 
evaluation by the Board of Examiners was filed prior to the date 

a new eligible list was established for that title shall: be 
entitled to continue in service in that title as long as necessary 
to complete s:.ch evaluation. 

B. Licensing: 

The interim licensing system shall terminate for a partic- 
ular title as of the date the Board of Examiners promulgates the 
initial announcement of the Phase 1 examination for that title, 
provided that all unlicensed persons then serving in such title 
under valid assignment pursuant to the interim system, shall have 
the option to be evaluated on the basis of their on-the-job per- 
Zormance and to receive permanent licenses pursuant to that 
system if they have applied or apply for evaluation no later 
than five months and 1 day following such promulgation date; 


alternatively, such individuals may elect to have up to five 
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months of actual acting service in the title credited, together 


with subsequent service in said position, for the purpose of 
determining the date they become eligible for on-the-job evalu- 
ation by the appointing authority for purposes of permanent 


licensure under the new system. 


V Board of Examiners Staff 
This Plan will facilitate conversion by the Board of Examiners 
to a staffing pattern which avoids its present and almost exclusive 


reliance on currently employed teaching and supervisory personnel 


in favor of professionally trained personnel and consultants from 


the testing and measurement field, as well as from private industry. 


No member of the staff shall participate in the development 
or administration of any test, analysis or evaluation, without 
having first received appropriate training, with particular 
emphasis on training in E.E.0.C. testing and validation guidelines. 
Affirmative action recruitment efforts will be made to attempt 
to make the staff representative of diverse segments of the com- 


munity. 


VI Reporting Provisions 
For a period commencing with the date of this Order and 


ending two years after permanent licenses have been promulgated 
for the first three positions for which eligible lists are estab- 
lished pursuant to this Plan, defendants shall comply with the 
following provisions for collecting, maintaining and furnishing 
data to plaintiffs' counsel: 
A. Phase 1 Examinations 

1. Development. 

Ten days before the announcement of the holding of any 

examination, the Board of Education shall provide 

plaintiffs' counsel with: 

a. A statement of the number of vacancies determined 


to exist in each position for which Step 1 examinations 


|~ 
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are announced, a description of experience, training 


and any other requirements established by the Chancellor 


for each such position, and all pertinent background 
information bearing on the establishment or continu- 
ance of such requirements. 
b. A full description of examination procedures. 
Administration. 
a. The Board of Examiners shall provide plaintiffs' 
counsel with copies of all examination announcements 
at the time such announcements are released. 
b. Promptly after examinations are held, the Board 
of Examiners shall provide plaintiffs' counsel with 
the following: 
i. Copies of examinations. 
ii. A report on the racial and ethnic character, 
i.e., black, Puerto Rican or Latin American 
descent or origin, or other [hereinafter racial/ 
ethnic], of the persons who administer the 
examination. 
iii. A report on the racial/ethnic breakdown 
of the groups of candidates applying for, taking, 
passing and failing each each examination. Said 
reports shall also be submitted to the Court at 
the times specified. 
iv. A copy of the notice given to applicants 


regarding their right of appeal. 


Phase 2 Examinations 


Development. 


Defendant Board of Education shall furnish plaintiffs' 


counsel copies of all rating, evaluation and any other 


forms and/or instructions furnished to appointing 


authorities for use in on-the-job evaluations. “hese 


shall be made available immediately following their 
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first distribution to appointing authorities for 


comment or otherwise, but in no event later than two 
months before the first on-the-job evaluation in which 
they are to be used. 

2. Administration. 

Commencing 15 months after the promulgation of the first 


new eligible list to be established pursuant hereto, 


defendant Board of Education will submit to plaintiffs’ 
counsel and the Court quarterly reports on the conduct 
and outcome of on-the-job evaluations of persons on 
such lists, including: 
a. Number of applicants for on-the-job evaluation 
from each promulgated list since last reporting; 
b. Number of evaluations of applicants from each 
list; 
c. Pass-fail data for applicants from each list 
by race/ethnic group and community school district 
or other appointing authority. 
C. General. 
Defendants shall make available to plaintiffs' counsel all 
other data, studies, analyses and reports relevant to the 
devélopment, administration and implementation of this Plan 
and generated in the course of said development, administration, 


or implementation. 
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BOSTON M. Cli, IPMIS C. MERCADO 
et al., ; 
AFTFIOAWIT 


Plaintiffs: 


70 Civ. 4141 
~against- 


THE BOARD OF EXAMINERS, et al., 


STATE OF NEW YORK ) 
COUNIY OF KINGS ) 

ROBERT CHRISTE.:, boing duly sworn, deposes and says: 

1. I am Vice Frasident of the Eoard of Education of the City of Mar 
York, ani am fully fatiliar with all of the facts and circumstances herein. 

2. I submit this affidavit in support of the motion of the Mew York 
City Boarc of Education and Chancellor of the City School District for an 
Order acjroving the mxlifiec Plan for licensing and selecting Supervisors in 
the Nes York City s System annexed hereto as Exhibit "1," and permitting 
the dzfondantste develo,» a new supervisory selection and licensing systen 
in accordance with this nedified Plan. 

3. The Plan for a new supervisory selection system submitted herewith 
for approvel constitutes a modified version of the Plan approved by this 
Court in its Order of tlarch 25, 1975. 

4. This March 25, 1975 Order resulted from an initial finding ny this 
Court ca July 14, 1971, and affirmed by; the Court of Avceals on April 5, 1972, 

City school systet,presarec ind 
Vourd uf Exaininers had the “effect of dissriinatinc 
aya Po2rtodican candidates.” Tnis Court further found that th 
Meerd of Lxaminors could not satisfy its burden of dernst ratuyy that its 
cxaminations were job-1elated, holding sp-cifically that "the beard has not, 
in practice, achieved ti.2 goa) of coastructing exatinetion procedures that ar 


truly jes-reluted." 
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5S. ‘the Plan for a now supervisory selection system submitted herewith 


for approval constitutes a modified version of the Plan approved by the Court 
in its Order of March 25, 1975. 
6. ‘lis modified version of the Plan would enable the defendants to 

implement a non-discriminatory and job-rei ted permanent selection system and 

also bring an end to the interim selection system and to this litigation, 

_in the nost expeditious and economical manner feasible. By contrast, an 
“attempt to implement the original Plan would delay institution ofa 
permanent system for many additional months and indeed, probably, years, 
utilizing procedures that are very costiy and complicated, * the sare tire 

* 


ottering no assurance that the resultant system would be non-discriminatory 


and job-related. 


{ 


7. The modified Plan constitutes a simplification of the original Plan, 


, eliminating many time-consuming steps. Thus, for example, the Board of 


Education would not be required under the modified Plan to conduct elaborate 


i 


job analyses for each of the approximately 44 supervisery job titles. Conduct 


4 


ef such analyses under the Original Plan for just three title= consumed. 6 
months at a cost of $36,699 and resulted, as indicaved below, in job analyses 
which had to be rejected because of their inadequacy. The medified Plan also 
'sir.ifies the Phase 1 examination, which will mean that new eligible lists 
na be prepared by the Poard of Examiners in a fraction of the time and at a 
fraction of .e cost, that would have been required under the original Plan. 
The Phase 1 examination under the modified Plan more closely resembles current 
‘practices in government, industry and institutions of higher learning. The 
modified Plan also provides for drastically simplified reporting provisions as _ 
compared to the original Plan. 

8. ‘she sirplicity of the modified Plan, the reduction of the burden 
imposed on Cefcndants, and the consequent reduction in the time that will be 
reyuirsd to implerant it is illustrated by a comparison of the relative length 


Of the tivo plans--the orisinal Plan was 25 pages in length, supplerented by 


several pages relating to the os ee provisions of that Plan which were 

» Contained in paragraph VII of the March 25, 1975 Order. ‘The modified Plan is 

| a total of 8 pages wnich include all necessary reporting provisions. 

9. The modified Plan retains, however, the essential elements of the 

" Original Ptan: (1) an evaluation by the Board of Examiners cf all candidates 

to determine whether they are qualified for placament on eligible lists and 

| provisional licensure; (2) evaluation of all candidates appointed from said 

! eligible lists after one year of service to detenaine whether, on the basis 

of their on-the-job performance, they are qualified for permanent licensure. 
10. While retaining these essential elements of the original Plan, 

; we believe that the modified Plan is an improvement over the original Plan 

: in that it provides for the development of a Supervisory selection system in 

| a Simple and muwre economical way, and with more assurance that the selection 

# system will be non-discriminatory, and as is is more fully dascribed below, 

| ig responsive to current needs, whereas the Original Plan is not. 

ll. The defendant Board of Education's instant motion to modify the 

f March 25, 1975 Order and Plan is based on its conclusion that the origine”. 

| Plan is complicated, unwieldy and costly, that portions of it have proved to 

be unworkable, and that changes in circumstances since March, 1975 require 


; the modifications reflected in the Plan submitted herewith. As set forth 


(a) The firsi. jc analyses conducted pursuant to the Plan proved 


i| inadequate and had to ke rejected. 


(b) The City's presence Fiscal crigis has required the Board of 
Education to cut back on expenses. Inplemanta! ica of the original Plan would 
be fiscally and educationally irresponsible since it would require expenditure 
of monies on an inordinately @mensiv2 Plan without any assurance that the 
resultant system would be non-discriminatory and job-related. ‘The rodified 
Plan could be implemented and edninistereda much Jess expensively, thus freeing 


up monies for vital educational services. Moreover, the modified Plan is, in 
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our vicw, better designed to provide for the selection of qualificd super- 


visors than the original Plan. ‘therefore the finencial savings will be 


, accomplished without any sacrifice in the quality of the permanent selection 


system. 


(C) There ary fo Weenies in any Supervisory positions at the 


_ Present time, making the development of an elaborate job analysis and Phase ] 


' examination scheme for each Supervisory title, as called for under the original 


Plan, particularly wasteful. 


A 


(a) Cur experience with on-th s-eb evaluations in the past two years 
* ‘have led us to conclude th-t these evaluations should be conducted solely by 
, the appointing authorities, as they are most familiar with the work done by 
the supervisor. A separate on-the-jod evaluation by the Board of Exaniners 
weia not be effective, and would result ina useless expenditure of funds. 
(See below for more detailed explanation of paragraphs (a)-(d) herein- 


: _ above set forth.) 


(a)_Rejection of first job analyses conducted pursuant to the Plan. 
12. Under the termsof the original Plan, the first step in the implementa- 
tion of a permanent licensing system required the Poard of Education to 
» develop prototypical job analyses for three supervisory positions. 


13. In atterpting t> implement this requiremsiit, the Board of Education 


ihired the American Institutes for Research (hereinafter referred to as AIR), to 


‘prepare job analyses for these 3 titles. These job analyses, which had %0 be 


rejected, inter alia, for the reasons set forth below, took 6 months to 


“complete, and cost the Board of Educatica $36,699. 


i 


14. The original Plan provided that job analyses will be subject to review 


by various educators and groups of educational experts, including a college cr 


university specialist in the relevant areca, a personnel specialist from outside 


the citi: school syater, et. al, ‘ 


and that these persens and groups will make 


reconmendations 


to the Board concumiing the job anal mses, and that ‘the 


decision of the Board of Uducation...shall be final." 
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When the first three job analyses were completed, the Board of Educa- 


15. 


‘ tion, as requircd by the original Pla occeded to consult with these 
‘various educators and educational groups as to the merits of these analyses. 
16. Very strong criticism as to the validity and usefulness of these 
analyses was raised by various groups and educators, representing a broad 

spectrum of the educational community. 


17. On March 1, 1976, the Chancellor's Advisory Council on the Selection 


. Of Acting Supervisory Personnel informed the Chancellor that the Council 

» unanimously rejected these analyses. This Council includes representatives 
of a broad spectrum of the educational community, among them the organiza- 

3 tion of 450 City school parent associations (United Parents Association), 
the Council of Supervisors and Administrators of the City of New York, the 

' Association of Cammimity School Boards, the Association of Cammmity Superin- 
tendents, the Anti-Defamation League of Bnai Brith, the Public Education 

: Association, and the Division of Personnel of the Board of Education of the 

City of New York. 

18. A copy of the Jetter of the Chancellor's Advisory Council rejecting 
’ the AIR analyses is annexed hereto as Exhibit "2." As is evident from this 
letter, same of the reasons upon which the Council based its decision to 
reject the analyses were that they were vague and confusing, the cost factor, 
the lack of any assurance that tests based upon the job analyses will produce 
the best type of supervision, and the lack of evidence that the resulting 
new examinations would be bias free, 

19. The Council further recommended to the Chancellor that he “urge the 
Board of Education to reject the AIR Report in its entirety and allow us to 
concentrate, instead, on alternative methods of selecting supervisors. To do 
otherwise would be tim consuning and unproductive." 

20. Other strong criticisms of the AIR analyses were included in reports 
by individual members of the Board of Education, see e.g., Exhibit "3," herein, 
@ memorandum by Board ~.mber Amelia Ashe, and independent consultants, see 
e.g., Exhibit "4," herein, the report of Dr. Robert Owen. 

21. Moreover, the plaintiffs advised the Board of Education and the 


Corporation Counsel] that after formal consultation with testing experts ani 
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, @ducators, they have concluded that the AIR analyses would not provide a valic 


basis for developing constitutional licensing procedures. 


i 


i 22. Thus, it is cleaf that should the original Plan be adhered to, 

‘ new job analyses would have to be conducted, involving large expenditures of 
} 

|, Money, consuming much time, and offering no assurance that they will produce 


. Non-discriminatory job-related exams. 


23. Under the modified Plan, being submitted herewith, no job analyses 


‘ 


‘are required, and thus, the Plan can be implemented expBditiously, and 


deo: there is little possibility that the examinations called for in the 


i! 
' modified Plan would be discriminatory or non-job-related. 
24. Moreover, by eliminating the jab analyses, Phase 1 of the modified 


" " Plan avoids problems of bies and invalidity inherent in the Original Plan 


<_< job analyses. These analyses required by the original Plan would 
y 


necessarily have to be based on the views of supervisors that are presently 
‘| 
i in the system, and most of the Present supervisors came into the system via 
ji F 
‘ the selection procedures that were held to be discriminatory. ' 


( (b) The fiscal crisis facing the city school system. 
i 


25. 


The decision of the Board of Education and the Chancellor to make 
: this motion was considered in relation to many complex and intervening 


: ‘ considerations, acising in the midst of the most difficult and unprecedented 


bs | 
1‘ 


| 

\ fiscal erisis ever faced by the city school system. 

| 26. Due to this fiscal crisis, the Board of Education of the City of New 
, York has ween subject to unprecedented budget cuts. 

27. Effective Septenber, 1975, the Board of Education was directed by the 


) City to cut its annual budget by approximately $250 million. This initial 


,, Cut necessitated the eliminaticn of thousands of teaching positions, the 


shortening of the schoo! Gay, increase in class sizes, 


as well as the curtail- 


Ment of many vital educational programs 


28. After having made these initial budget cuts in the amount of $250 


million, the Board of Education was further directed by the City, in December 


of 1975, to implement additional cuts Of $37.45 million. 
29. 


It is the intention of the Board of Education to cffectuate these 


budget cuts in such a manner as to minimi 


ze the impact upon the school 


instructional day for youngsters as far as possible. 
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30. The original Plan involves a vastly complicated and expensive procedure 


: for the preparation of examinations, with little or no assurance that these 
examinations will achieve their purpose. 
31. In addition to the costliness of the job analyses, i.e., the original 
job analyses cost $36,699, and if the original Plan is adhered to, another 
_ Job analyses would have to be undertaken, eqerts at the Board of Education 
have estimated that the type of testing called for by Phase 1 of the original 
; Plan, would cost, at minimum $150 per applicant, and that the type of testing 
' envisaged by Phase 1 of the modified Plan will cost approximately $25-30 per 
applicant. Even if the estimate as to Pert 1 of the original Plan could be 
| halved, it would still be far more costly than the modified Plan. 
32. Moreover, notwithstanding the cost factor, it is the opinion of the 
" Board of Education and of the Chancellor that this modified Plan is better 
: designed to provide for the non-discriminatory selection of qualified super- 
i visors than the old Plan. It is less complicated, easier to administer, ané 
| offers little possibility that discriminatory and non-job-related testing 


:" devices will be promulgated. i 


(c) Present personnel requirements in the City School District differ 


from those envisaced by the original Plan. 
33. The original Plan was based on the assumption that the Board of 


: Education vould have a need to hire large numbers of supervisory personnel 

|, every year. 

34. Thus, the Plan contemplated separate examinations for each of the 
approximately 44 supervisory titles, and defined three positions as "proto- 

' typical" because they “cover the largest number of people in the supervissry 
categories, thus permitting the program to start in a meaningful way.” 
(p9.)The original Plan provided that new licensing procedures should ke 
developed first for these said three positions; principal, elementary school; 
assistant principal - high school (supervision), and assistant principal, 
elementary and junior high scheol. 

35. Tne situation has changed so dramatically since the date of this 2 
original] Plari, that because of the fiscal crisis and declining pupil registers 


and school closings, not only is there no present need for any additional 
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supervisors, but we now have FO. Se 143 excessed supervisors slated 
for layoff, with further layoffs scheduled for September of 1976. 

36. Thus, it would represent a useless expenditure of time and money to 
develop individual and coimlicated examinations for these positions, as 
required by the original Plan,since there is presently no need whatsoever 
for any additional supervisors in the school system, in these titles or in 
any other titles, and we predict that for years to come our need in this 
area will be minimal. 

37. Moreover, should examinations of the type envisaged in the old Plan 
be developed now, with no need therefor for many years, it is likely that with 
changed circumstances, in the future, the examinations will be useless. 

38. Thus, we submit that since our personnel recruitment need for 
supervisors in the forseeable future will be minimal, it is our responsibility 
to avoid expenditures c‘f money for complicated and costly examinations that are 
not presently needed, and when they are needed, may no longer be relevant. 
| 39. Accordingly, the modified Plan which we are proposing does not involve 
separate, complicated examinations for each title, but a flexible: systen which 
can easily be adjusted to present and future needs. 

(d) The appointing authorities rather than examination assistants shoulé 
conduct on-the-job evaluations, and Phase 2 of the modified Plan incorporetes 
this premise. 

(40) Since the implementation of the on-the-job testing procedures in the 
interim system,two years ago,it has become evident to the Board of Education end 
the Chancellor,that the persons best suited to evaluate a supervisor's on-the-ic: 
performance are the people in the field who come into daily contact with the 
supervisors. 

(41) The concept of an cr:-the-job examination, called for in Phase 2 of ths 
modified Plan, would be based on actual skills and the demands of the pactinr 
lar job. The determination of whether or not an individual's perforrance 
during the first year is satisfactory would be made by the appointing 
authority (e.g., community superintendent for decentralized district, Chancellor 
for central program). 

(42) In addition to having the rating nude by those who are most familiar 
with the work being dune by the supervisor, this would also result in great 
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cost savings in the examination haath Since examination assistants would not 
have to be employed. 
(43) Examination assistants are far less qualified than the superintendent 
to determinc whether service and competence is of such quality as to warant 
licensing leading to probationary appointment. 
(44) A separate on-the-job evaluation process by the Board of Examiners 
would be duplicative of the evaluations conducted by the appointing authorities. 
(45) In order to assure that the appointing authorities make evaluations 
which are based upon uniform standards and criteria, and actual requirements 
' for successful performance on the job, the Chanchellor has developed a 
comprehensive uniform rating and evaluation form, which has been used with 
much success by the appointing authorities during the past year, and which will | 
be continued under Phase 2 of the modified Plan. 


(46) This motion is entirely proper and consistent with the prior history 


of this case, and with the statutory responsibilities and duties of the 


Board of Ed: cation. 

(47) It is the Board of Education and not the Board of Examiners, that is 
required by law to "determine all policies of the city district," i.e., the 
City School District of the City of New York (§.2590-a(1) of Education Law). 
It is the Board of Educacio , and not the Board of Examiners, that is 
empowered to prepare and submit to the City the budget for the City School 
District, and which is required to prevent the incurrence of liabilities ar 
expenses in excess of the amount available therefor. (3.2590-i of Education 
Law) 

(48) It is the Board of Education, not the Board of Examiners, that is 
ultimately responsible for the education of children in the City's schools 
and for the selection and appointment of the teaching and supervisory personnel 
for those schools. It is the Boardof Education and the Chancellor that have 
the responsibility under State law for determining the education and 
experience criteria for each job title and for determining what qualities 
should be examined by the Board of Examiners and whether and when to ask 


the Board of Examiners to conduct examinations. 


(49) In view of the foregoing powers and dutics of the Board of Education <. 
" the Chancellor, we submit that it ieee responsibility of the Board of 
Education and the Chancellor to move to modify a supervisory selection plan 
; which is not responsive to the needs of the Board of Education of this City, 
and whose implementation will result in a large expenditure of funds for 
i the promulgation of a Plan which we believe is unworkable and unlikely to 
, Produce the best possible supervisors for the educational system. 
| (50) A motion to amend the 1975 Order based on changed circumstances would 
be proper under any circumstances. Moreover, despite the Board of Examiners’ 
protestations to the contrary, it is entirely consistent with the history of 
this case. 
(51) The March 25, 1975 Order was itself the result of a motion by the 
Board of Education, then joined by the Board of Examiners, to amend the 
iy _— 12, 1973 final judgment. The 1975 Order was not a consent Order, as 
| Characterized by the Board of Examiners. The plaintiffs cross-moved for entry 
" of a different order. As the record clearly indicates, settlement negotiations 
‘j between defendants and plaintiffs broke down over differences plaintiffs 
_ considered fundamental. 
(52) The only consent order entered in this case was the July 12, 1973 
consent juccment. 
(53) The instant motion constitutes the most expeditious way to bring this 
litigation to an end. Plaintiffs instituted this lawsuit in which the Board 
; of Education, since it has primary responsibility for the conduct of the City's 
schools, is the primary defendant. Plaintiffs and the Board of Education have 
: spent a great deal of time in the last several weeks attempting to arrive at 


an agreement which will avoid the necessity of further litigation between ther. 


It is my understanding that the modified Plan filed herewith reflects the 
product of that agreement. 
(54) ‘The Board of Examiners can have no legitimate ground for objecting to 
| Our proposed modification of the 1975 Order. The modified Pla would enable 
the prompt implementation of a permanent selection system that the Board of 
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Examiners claims it is concerned with. ‘he modificd Plan also provides a role 


for the Board of Fxaminers consistent with the role it has played in the past. 
It would conduct open qualifying "unassembled" examinations. Also, there is 
the added assurance that the modified Plan will more likely result in a 
selection system that is non-discriminatory than the old Plan. 

(55) Finally, it should be noted that the 1975 Order merely permitted 
and authorized defendants to proceed in accordance with its provisions. It 
did not mandate such action. Clearly defendant Board of Education, which tried 

in good faith to implement the Original Plan, and which has determined that in 
> Mae of changed circumstances said Plan should be modified, has in no way 
tao bened either the spirit or the letter of the 1975 Order. Rather, in 
seeking now to modify the Plan incorporated in the Order, the Board of 
Education is endeavoring to fulfill its obligation to facilitate implementation 
as rapidly as possible of a permanent new selection system which will be | 
, Workable, feasible, fiscally responsible, and responsive to current needs, and, 
: Since it appears to be satisfactory te the plaintiffs who brought this suit 
challenging the unconstitutionality of the old selection system, will hopefully | 


| 
bring to a close this six-years of litigation. 
i 


as [Pot £ Cs 


ROBERT CHRISTEN 


'Sworn to before me this 


12th day of April, 1976 
i: +ALL CETe od 
Pd 
fort LRT fin, 
EXHIBIT I - Board of Education's Modified Plan 
(printed at pp. 583a-590a) 


0024 : 
CHANCELLOR'S ADVISORY COUNCIL ON THE 
SELECT1LO"N OF ACTLisG SUPERVLSORY PERSONNEL 


March 1, 1976 


tix. Irving Anker 
Chancellor 

110 Livingston Streec 
Brooklyn, New York 11201 


Dear Mr. Anker: 


In accordance with your request for recommenda- 
tions concerning the A.I.R. Report dated June 1975, the 
members of your Advisory Council on the Selection of 
Acting Supervisory Personnel wish to submit the following 
highlights of their findings. 


The Council was unanimous in its opposition to 
the acceptance of the Report for the reasons indicated 
below: 


1. The Report fails to provide an adequate analysis as 
required by Court order in that it is filled with vague 
ana confusing descriptions. 


2. There is real concern over the cost of developing an¢ 
administering a new examination system in light of budget 
stringencies under which we are currently operating. 


3. There is no assurance that the job analysis will produce 
the best type of supervisor for New York City schools. 
4,.The Report concentrates on "what is" rather than on 
"yhat ought to be." 


5. There is no evidence that the resulting new examination 
system will be bias free. 


On the basis of this review, your Council recommends 
that you urge the Board of Education to reject the A.1I.R. 
Report in its entirety and allow us to concentrate, instead, 
on alternative methods of selecting supervisors. To do 
otherwise would be time consuming and unproductive. In 
keeping with this recommendation, and if you concur, the 
Council is prepared to explore specific sug:,estions for an 
alternative plan for s “ecting supervisory staff. 

é 

Be assured that we are anxious to be of assistance 
to you and the Board of Education because we believe that 
this is an area in hich we can make a worthwhile contribu- 
tion to the school system. We shall wait to hear from you 
concerning next steps before we proceed. 


Sincerely yours, 


bilaacke Fees 


“4d 


(Mrs.) BLANCHE LEWIS 
Chairperson 


. 
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JAMES F. PEGAN 


RAVING ANF ER! Crancrwoe j © 
HAROLO SIEGEL, Secactaas 2 me 


TO: All Board Members 
7 

FROM: Dr. Amelia Ashe Fk 

DATE: January 22, 1976 . 


RE: Board Policy Reaction to AIR Report 


The Federal Court Order by Judge Tyler in the Chance-Mercado case re- 
quired the Board to develop a job-related, non-discriminatory examination 
and a job analysis for all supervisory positions. , 


The job analysis done by AIR focused largely on the supervisors currently 
serving and therefore consisted of a determination of current job behaviors, 
These are the tasks the person performs, the amount of time devoted to 
these tasks, their relative importance, and the knowledge and skills which 
enable persons to perform these tasks successfully. The analysis is based 
largely on current practices. The Court Order also makes allowance for 
input by the Chancellor and others to indicate the nature of the job as it 
ought to be. Since the procedure by AIR made no effort to identify only 
superior supervisors in determining job behavior, it is conceivable that 
incidents of less than satisfactory behavior are included in the descriptions 

L/ of supervisors' performance. The group polled in the sample represented 
proportionately the current supervisory population. The sample group, 
which is low in minority membership may give data about their jobs which 
reflect the biases of the majority group. 


‘Two questions may be raiscud: 


1. If current practice is used as the accepted behavior, will this 
perpetuate whatever biases, cultural or — that may pre- 
o vail in the sample group? 


2. If current practice is not ideal, what ought it to bey Why should 
current practice be perpetuated? 


. 
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The AIR procedure in developing their report basically consisted of a collec- 
tion of incidents in which supervisors indicated items of importance which 
occurred as part of their job. 


Part Il consists of a job inventory checklist developed largely from the 
incident data and upon which supervisors were asked to indicate the rela- 
tive time spent in cach task and the relative irnportance of ecachtask. A 
“minimally acc -ble standards questionraire’' was developed by asking 
the sample gr: ether or not various behaviors derived trom the check- 
list were necessary to perform minimally in the position. ; 


Supervisors we.e also asked whether the behavior was necessary to discrim- 
inate between marginal and superior supervisors. There is a heavy reliance 
on the incumbents’ perception of their jobs and the perceived amount of time 
spent in each activity. Thesc estimates may be greatly at odds with reality 
even for highly qualified personnel. 


The review of the incident reports used to derive the checklist appears to 

be an informal process lacking in proper scientific methodology (e.g. factor 
analysis). In analyzing the ''minimally acceptable standards questionnaire," 
Modal responses were chosen rather than Mean assessments without ration- 
al explanation. 


One educator participating in the on-site observaticns believed that the knowl- 
edge/skills checklist (based upon ''minimally acceptable standards question- 
naire'') should include aspects of interpersonal skills. This idea was reject- 
ed because AIR thought such ev..luations to be too global or unreliable. 


The knowledge/skill checklist indicates that while many specific behaviors 
which use interpersonal skills ~re listed, these skills do not represent ade- 
quately the full range of skills necessary for a minimally acceptable super- 
visor. And even if they did represent the full range the measures used are 
insufficient. It may be that the most intangible skills are the most import- 
ant. A test which does measure such skills would be extraordinarily diffi- 
cult to develop. : 
The AIR Report implies a complete interchangeability among supervisors. 
AIR suggests that, in order to maintain maximum flexibility, specialized 
skills in specific areas need not be part of a general license. AIR recom- 
mends a consolidation of testing to create a test (for all supervisors) which 
measures tasks or skills common to all supervisory positions. This recom- 
mendation raises a fundamental question: Once a supervisor is selected, 
can (s)iie then be used interchangeably in a variety of subject areas? (e.g. 
can (s)he supervise with equal skill French or Special Education or Gym?) 
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The feasibility of limiting a job analysis to incumbent behaviors is questionable. 
These behaviors contain n.2ny ‘undesirable as well as desirable components. 


_Through sampling crror, or absence of a specific skill in ihe population sampled, 


many essential or desirable behaviors may be omitted. 


It is not clear that the court wished to limit the job analysis to current practices. 
The plan adopted by the court acknowledges the right of the Chancellor and others 
to review and include matters in the job analysis beyond the catalogue of incum- 
bent behaviors. 


Ecually important to the Board should be a concern for the intended use of the 
job analysis. We have a catalogue of behaviors, but how they relate to per- 
formance has mst been demonstrated. The relative “Mportance of these items 
may have little or no relztionship to what is actively required of minirnally 
acceptable or superior supervisors. Factor 2nalysis might have been applied 
to the collected data to asczrtain which of the areas within the job analysis 
are related. An appropriate method for developing an instrument based on 
this analysis must employ methodology such as multiple regression to deter- 
mine the factors, and the weights of those factors, to predict the ability of 
a supervisur to function up to minimal standards as well as the ability of a 
supervisor to function in a superior manner. The use of a catalogue of 
skilis and knowledge without concrete demonstration of Jelationship-will 

é€ 


probably fall eventually into the same aréas ¢t disrepute into which previous 


exams have fallen. That is, it wil! be increasingly obvious that "job-related 
‘tests'' test only that knowledge and skill which incurnbenis ’- ! 975 believed to 


be of importance. It should ve noted that exam‘ner: in the pz “t have also 
drawn from the ranks of incumbents, in effect the establishment, " 


‘AA:RH:SC:ps 


cc: Mr. Irving Anker 
Mr. Harold Siegel 
Mr. Gary Sousa 


~ TEL. 516 .58>-066 


RCBERT G. OWENS, PH.D. 


CONSULTANT TO EDUCATIONAL ORGANIZATIONS 


2 GAMECOCK LANE 
BABYLON. NEW YORK 11702 
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Mr. Harold Siegel, Secretary 
Board of Education 

110 Livingston Street 
Brookiyn, N.Y. 11201 


Dear Mr. Siegel: 


As you requested, I have reviewed Figures 12, 13, and 14 
of Prototype Job Analyses of Three Suvervisory Positions 
Within the New York Citv School Svsten,. note that 
this material was not before me at the time that I pre- 
pared my letter of August 16. 


These summaries of questionnaire responses confirm my 
view that the investigation was aporopriately based 
upon data required by its design. Further, the addi- 
tional data provide a useful response to my concern 
about the vagueness of such terms as "managing" and 
"providing" as they were used in the study. If the 
breakdown provided by Figures 12-14 had been included 
in the original report or, better yet, if the informa- 
tion contained in the Figures were discussed more 
clearly in the body of the report my comment that 
"various'duty areas' are vague as stated... " would 
not have been made on page 3 of my letter. 


Otherwise, on the basis of the material submitted to 
me, my review of the study conducted by American In- 
stitutes for Research remains as stated, 

Sincerely yours, 


(bd Ou 


Robert G. Qwens 


Espa? |b 


: TEL. 516.587.5066 


ROBE RT G. OWENS. PH.D. 
CONSULTANT TO EDUCATIONAL ORGANIZATIONS r 
GAMECOCK LANE - by eae \u 
nies \ 4 a? 


BABYLON, NEW YORK 11702 4-7 
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Mr. Raymond Greenstein, Acministrator 

Office of Training Serviccs 

Bureau of Pre-Professional Training and Career Development 
Board of Education of the City of New York 

38 Park Row 

New York, N.Y. 10038 


Dear Mr. Greenstein: 
At your request I have reviewed the job analyses pre- 
® pared by t..e American Institutes for Research, Specifically, 
rs this report of that review is based upon five documents 


which have been made available to me: 


1. Prototyne Job Analyses of Three Supervisory Positions 
Within the New York City School Systen, 


2. Appendix A: Incident Collection Forms, 


3. Appendix B: Job Inventory Checklist Procedures, On- 
Site Observation Procedures, 


4. Appendix C: Reports of Community School District 
Visits - Abstract of Incidents, 


de Appendix D: Judgments of Minimally Acceptable Stan- 
dards. 


My review is based upon these documents. 


Descrivtion of the Analyses. As consultant to the New 
York City Board of Education, American Institutes for Re- 
searco endeavored to produce prototypical job analyses for 
three supervisory positions: 

* Principal of Elementary School, 


* Assistant Principal of Elementary, Intermediate and 
Junior High Schools, 


* Assistant Princival (Supervision) in Day Academic and 
Vocational High Schools. 


ATTACHMENT 


a 
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The documents make it clear that the consultant firm 

sougnt not merely to produce job analyses of these pos: "ions, 
but to exemolify a methodology for producing job analyses of 

other, related, positions. The context for all of this is 
the Chance-Mercardo court case and the goal is to lay the 
groundwork for more effective examinations and licensinz 
procecures. The work sina in this instance by American In-. 
stitutes for Research has considerable potential for long- 
term impact upon eee procedures for supervisors in 
the New York City schools. 


Procedures employed. The job analyses were conducted 
utilizing three approaches to data collection: 


1, eritical incident reporting, 
2. joo task inventory, 
3. on-site observations. 


The consultant firm chose to call this a multimethod an- 
proach and freely admits that this choice was theirs in lieu 
of methods suggested by the chancellor, the Board of Educa- 
tion, and the Board of Examiners. 


Essentially, the so-called multimethod utilized to con- 
duct the job analyses was a complex self-report technique 
whicn sought to have role incumbents provide infermation as 
to the work they did and their views concerning minimum 
standards for performing such work. This fact becomes 
crucially important when we realize that the consulting firm 
is not merely purporting to have performed a job analysis of 
each of three supervisory positions, but also proffers their 
methodology as a prototype for similar analyses to be done 
of many oth2r positions. 


Analyses and interpretations made by the consultants. 
Within the limitations imposed by their study design and. 
data-gatherins procedures, the analyses and interpretations 
revorted by the consultant firm are appropriate and weli- 
supported by their data. Within the limitations imposed 
upon such an investigation by the "real" world in which 
they were operating, their samoling procedures, item ge- 
neration and validation procedures, and other data-genera- 
tins, procedures were carefully carried out in highly ap- 
propriate ways. 


‘ 
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Conclusions reacied by the investicators. The invest 
Bators identify and describe a numder of conclusions in dis- 
cursive fashion (pp. 123-127). Among these are the following: 


1. ". . . that the procedures used and the general re- 
Sults obtained are applicable to all 14 of the school 
Supervisor positions" (which are included in the Agreement 
between the Board of Education and the Council of Super- 
visors and Administrators), ! 


Comment. Due to serious limitations imposed upon this 
Study by critical factors of the research design, this 
conclusion is. highly conjectural. Further comment on 
’ this general notion is made below under the discussion of 
: the Limitations of the research, 


2. That Instructional Administration, Personnel Adminis- 
tration, Community-School Administration, and School Ad- 
ministration are four broad elements which are ". . . un- 
: Questionably ccmmon to the successful operation of any 
. scnool organization" and, further, that 19 "duty areas" 
are also convion elements that are generally applicable 
to él] school supervisdy positions (pp, 123~121). 


Comzent. There is sufficient internal validity in the 
study to warrant the use of this idiosyncratic analysis, 
it wovld have been helrful to have indicated how the 
various "duty areas" are subsumed under the respective 
“4 "elements", The "duty areas" are vague as stated because 

such terms as "establishing", "providing", "selecting", 
"organizing", "managing", and "promoting" are not defined 
beraviorally - or, indeed, in any other way. In terms 
of cn-the-job behavior, such a list is open to a range of 
inte: pretations as to what would be appropriate. There 

is data in the research report which would enable such 

cad clarifications to be made in systematic behavioral terms. 


3. That supervisory positions will, to some extent, 
Share these "broad elements" in common and will also deal 
“ith svecialized elements that are not shared universal- 
ly by al] supervisory positions. Further, that by empha- 
Sizing the common elements of various supervisory posi- 
tions it should be possible to reduce the number of su- 
pervisory titles involved in examination and licensing 
procedures (pp. 125-126). 


Corment. Not only is this conclusion supported by the 
gate generated in the s.ady. it reflects a view widely 
held in the profession. The "concept of a single license" 
(np, 126), for examp)e, haw been a basic concept under- 
lying certification vravtices in New York State for 

some years (there being in fact, onlv one form of 
certification to cover 21] school-building-level super- 
visory vositions). 


aw . 
> ‘ 1 
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ie "The data also give some credence to the concept of 
“- single license for both principals and assistant vrin- 
cipals at the elementary school levels with perha”s 
ome minimum period of tenure as an assistant vrincinal 
before bing assisned as a princinal." (p, 126 - emphasis 
odded). 


Comment. While the data presented in t:> report jo2s 
ceive some credence to the concept of a cingle license, 
the notion of requiring a period of tenure as assistant 
principal prior to assignment as principal does not ap- 
pear to be derived from the data. This point appears 
to be gratuitous speculation and should, :n itself, be 
studied before being stated as a conclusicn hased upon 
analysis. What evidence is there, for example, that 
the job behavior of principals who had “served as assis- 
tant principals differs systematically fzom those who 
have not served in that capacity ? 


5. Overall licensing procedures should contain two 
major segments: (1) examination prior to assignment, 
pe on-the-job evaluation after assignment (pp. 126- 
tev. 


Comment. This is, of course, a time-honored *>-commen- 
Cation customarily proffered by those conce-ne¢e with 
evaluating the qualifications of indivicuals prior to 
professional service. While this conclusion does not 
appear to be derived from the research data, it is not 
in conflict with it and is good common sense. ‘ie i) 
vestigators are helpful, however, in suggesting ways 11 
which findings of this study may be useful in on-the- 
job evaluation. 


Limitations of the research, An appraisal of this 
Study - which purports not only to yield job analyses o! 
three supervisory positions but also to offer a prototypic 
model for conducting such analyses for other positions in 
the future - requires some consideration of the limi- 
tations imposed by the research design which has been 
utilized. There are several important factors in the de- 
Sign of this varticular stucy which raise serious questions 
concerning the broad claims of the investigators that they 
have, in fact, produced job anaiyses that are appropriate 
for examination and licensing procedures on the one hand 
and a prototypic model for developing job analyses on the 
other hand, These limitations in the design of the study 
are revealed most clearly by what is not said inthe report. 


Ee. ; : ; a]; 
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1. In developing their self-report "multimethod", it 
is noteworthy that the investigators sought data exclusively 
from (1) incumbents, (2) their superordinates(who are former 
incumbents), and (3) a small number of Community School Board 
members, There is no evidence that systematic data was 
sougnt from the subordinates over whom the incumbents have 
Supervisory authority. Thus the study is bereft of infor- 
mation as to the impact that the various job-behaviors and 
roles which supervisors have assigned to themselves is ex- 
perienced by those who are supposed to be the chief bene- 
ficiaries, Yet there are few issues in the realm of super- 
vision which have attracted more attention than the dis- 
crepancy between the views of supervisors and their subor- 
dinates as to what constitutes effective supervisory be- 
havior. There is, therefore, a strong possibility that the 
activities which the supervisors think of as "good" and 
"effective" may be viewed in quite different terms by 
teachers, 


One brief illustration may be helpful. Predictably, 
the researchers found that supervisors tend to view them- 
selves as teachers of teachers and - as such - deem it 
important for them to give model demonstration lessons for 
the edification of their subordinates, This is a persistent 
tradition among suvervisors in New York City schools and, 
yet, is the kind of work activity which few students of 
Supervision would expect to be very effective. It is re- 
markable - and a defect in the study's design - that the 
efficacy of this job behavior was not checked with the per- 
ceptions of those whom it is supposed to benefit. 


This desisn problem assures that the job analyses will 
be dominated by the values and traditions of the incumbents 
and their superordinates (former incumbents) and tends to 
establish the norm that job analyses should be undertaken 
in such a manner, 


2. The desictn of the study assures that influence of 
those outside of the existing ranks will be minimized. Thus, 
the study is innocent of any reference to other research or 
scholarly thought, and no exvert opinion was sought in es- 
tablishing the apnorop:iateness of the "elements" and the 
"duty areas" which were finally identified. 


Again, a brief illustration might be helpful. On p.124 
the investigators state: ". . . all of these elements must be 
handled by the team of first-line supervisors who directly 
run the schonl" (emphasis added), This concept of team- 
functioning is crucial to contemporary concepts of school 


On 


Mi. Raivmond Greenstein Aur::st, 16, 1975 p.4 of 


6l3a 


sunervisior. Indeed, in my own work with principals of New 
York City schools I increasinely hear expressions of need 
for #reater team-work between assistant princivals and prin- 
cipals. Yet, the study does not identify the skills of 
team-membershipv and effective group participation as impor- 
tant "elements" or "duty areas", 


Contact with contemporary literature on supervision and 
students of the field may well have avoided this tyne of pit- 
fail. : 


3. The study did not seek to de qualitative in either 
(a) the gathering of data or (b) establishing minimally 
acceptable standards of performance on the job. The study 
does not reveal any distinction between the behavior of those 
supervisors who are deemed successful (by any standard) from 
those who may be less successful. ‘Thus, we have merely a 
statement of what an undifferentiated group cf supervisors do 
on the job. One might supvose that a study aimed at setting 
standards for licensing would seek to distinguish the per- 
formance of superior supervisors from that of others. The 
effort reported in the study to establish some sort of norm 
for minimally-acceptable standards for performance is sub- 
jective without any indenendent refereeing or rating of per- 
formarce,. 


-4. In a setting which is characterized by rapid change 
and the need to deal with that dominant fact, the study is 
singularly noesent-oriented and the prototypic model which it 
seeks to establish is notably lacking in mornhogenic charac- 
teristics. The investigators could have greatly strengthened 
the utility of their findings by seeking to obtain from their 
respondants, perhavs by using tne Delphi technique, some 
expert future-oriented opinions focused on what suvervisors 
in New York City schools will need to be able to do in the 
predictable future rather than to confine their study ex- 
clusivelvy to what jobe-skills have been needed in the past, 
This tends to reinforce a tendency in American school suner- 
vision which has evo’éd a great deal of criticism: Namely, 
that it has responded too little and too late to ravidly 
chaneing events and has tended to rigidly perpetuate the 
dogma of the past. 


Sincerely yours, 


(los 


* Robert G. Owens 
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Board of Examiners’ Notice of Motion dated 

April 20, 1976, together with supporting 

affidavits of Murray Rockowitz, Julius R. 

Rubin, and Saul Z. Cohen (plus exhibits), 
Sworn to April 19, 1976 


= 
Qh. 


gon} noes d® 


PLEASE TAKE NOTICE that, upon the &nnexmi affida- 


vits of Murray Rockowitz, Julius R. Rubin and Saul Z. Cohen, 


i ali sworn to April 19, 1976, and upon the Consent Judgment 
entered July 12, 1973 as modified by the Order entered 
Marcn <5, 1975 (the "Consent Judgment") and the pleadings 
and ail other papers and proceedings had herein, defendant 
Board of Examiners will move this Court, at the United 

| 

| 


| 
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WITEG STATES DISTRICT COURT ; 
| SOUTHALL. DISTHICT OF NEW YORK if 
ee ee ee x 
BOSTON '1. CHANCE, et al., : 
Plaintiffs, : 
NOTICE OF MOTION 
~against~ : 
70 Civ. 414) 

THE BOARD OF EXAMINERS AND THE : (M.P. 

BOARD OF EDUCATION OF THE CITY sae 

OF NEW YORK, et al., : =: cy. 

rae = 
e 3 =«* 
Defendants. : z- Se : 
: . 2S =e 
ee ee * 2 ne Se 
= <= 
SIRS: : w s-: 
| 


Foley Square, New York, New York, at a 


date and time to be designated by this Court, for an crder: 


States Courthouse, 

(a) Pursuant to paragraph XIV of the Consent Judg- 
ment and Rule 70 of tne Federal Rules of Civil Procedure, 
implementing the Consent Judgment by authorizing and 


directing defendant Boa: < of Examiners to prepare, at the 


expense of the Board of Education, job analyses for the 


three prototypical positions described in the Plan for 


plenary examinations for supervisory personnel in the New 


York City school system which is part of the Consent Judg- 


ment in accordance > with, and as required by, that Plan, on 


the ground that defendant Board of Education has fitied and 


eee to obey the Consent Judgment by adopting such job 


Ahalvyses:; and 
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(b) Granting such other, further and different 


relief as this Court may deem just and proper. 


Dated: New York, New York 


TO: 


April 20, 1976 


Yours, etc., 


KAYE, SCHOLER, FIERMAN, HAYS & HANDLER 
Attorneys for Defendant Board of 
Examiners 


By A CMLAA Co ne 


A Member of the Firm 


425 Park Avenue 
New York, New York 10022 
759-8400 


ELIZABETH B. DUBOIS, ESQ. 
Legal Action Center of the 
City of New York, Inc. 

271 Madison Avenue 
New York, New York 10016 


JEANNE R. SILVER FRANKL, ESQ. 
Public Education Association 
20 West 40 Street 
New York, New York 10018 


Attorneys for Plaintitfs 


DEBORAH ROTHMAN, ESQ. 

Assistant Corporation Counsel 

Law Department of the City of 
New York 

Municipal Building 

New York, New York 10007 


Attorney for Defendants Board of 
Education and Chancellor of the 
City School District 


LEONARD GREENWALD, ESQ. 
Frankle & Greenwald 

80 Eighth Avenue 

New York, New York 10011 


Attorneys for Intervenor CSA 


Fi 


EI ac 0 IS i 88 Ag 2, an ance anaes smm . Le eg 
ot IORI, ACHR SONI." NN 8 AR RENE ARBORS AERA MLE 


SOUTHERN DISTRICT OF NEW YORK 


“ef lS Se hee ee le ele a lm an! of lw 


CHANCE, et al., 


nm 


Pisintiffre, 


THE BOARD OF EXAMINERS AN 
BOARD OF EDUCATION OF THE CITY 
OF NEW YORK, et al., 


Defendants. 


ee oe ee ee ee! ae ee a ee ae ae ae a 


STATE OF NEW YORK 


COUNTY OF NEW YORK ) 


MURRAY ROCKOWITZ, being duly sworn, deposes 


I am a member of the Board of Examiners and 
have held that pos on since September 1966. 
September 1971 to September 1975, I was Chairman of the 
Board of Examiners. I am fully familiar with all aspects 
of this matter and submit this affidavit in Support of the 
Board of Examiners' motion to require immediate implementz2- 
tion of the Consent Judgment, as modified, by authorizing 
and directing the Board of Examiners to prepare job ana 


| for the three prototype Supervisory positions described ?: 


the Plan which is part of that Judgment. 


Introduction. 

. By statute, the Board of Examiners is ex- 
pressly given the responsibility of preparing and adminis- 
} tering objective plenary examinations for supervisors in 


| the New York City school system. In order to give future 


<r ma 


| 
| 
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supervisory examinations wider community acceptance, the 
Board of Examiners agreed in 1973 to a two-part settlement 


of this case. That settlement resulted in the entry of the : 


July 12, 1973 Consent Judgment. The first part of the 


| 
| 
| 
| 


settlement called for the implementation of an "interim" 
sclection and licensing system whereby licenses could be | 
obtained by the large number of supervisors who had been 
appointed on an "acting" basis during the pendency of this 
case, and others who would be similarly appointed before a4 
permanent Plan for plenary examinations was implemented. 

The second part of the settlement called for the developmen: 
of such a permanent Plan by a Task Force consisting of the 
parties and their designees. The "interim" system was 
implemented in 197 1d the parties submitted an agreed 

upon Plan to Judge Tyler in May 1974. Thereafter, Judge 


Tyler approved the Plan in January 1975 and formally made 


| 
| 
| 
| 
| 
it part of the Consent Judgment in March 1975. | 
3. Under the Plan, the Board of Education is to 
adopt job analyses for three prototypical supervisory posi- | 
tions, utilizing an independent consulting firm, so that | 
the Board of Examiners can, in turn, prepare prototype | 
examinations for those positions utilizing its independent 
consulting firm. In the future, the prototype analyses | 
and examinations are to serve as models for the preparation 
of analyses and examinations for all supervisory positions. 
4, It is now over 22 months sir.ce the Plan was : 
initially submitted to this Court, about 15 months since 


Judge Tyler approved it and over a year since it was 


formally made part of te Consent Judgment. Yet, the 


} Board of Education has still not adopted the prototype 
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job analyses required under the Plan. Since the Board of 


Education is unwilling to do so, the Board of Examiners 


has made the instant motion for an order authorizing and 


Girecting it to prepare the prototype job analyses. Only 
by entry of such an orctr can the Board of Examiners orc- 
ceed with the preparation and administration of the proto- 
type examinations which are necessary to implement the 


Judgment, and thus fulfill its statutory responsibility. 


York State's Constitution 
and Education Law. 


New 


5. New York State's Constitution and Education 
Law require that all civil service appointments shall be 
made by "objective" examinations to determine "merit and 
fitness" and that the Board of Examiners shall "prepare 
and administer" those examinations for all supervisory 
positions in the New York “ity school system. 

6. Article 5, Section 6 of the New York State 
Constitution requires that: | 
service of the state and all of the civil 
divisions thereof, including cities and 

villages, shall be made according to merit 

and fitness to be ascertained as far as 

practicable, by examination, which, as far 

as practicable, shall be competitive. ..." | 

| 

7. The New York State Education Law repeatediy | 
provides that the examinations required by New York's Con- 
stitution must be "objective" and must be "prepare[d] and 
administer[ed]" by the Board of Examiners. Thus, Section 
2569(1)(a) of the Education Law provides that: 

“iu shall be the duty of the board [of examiners? j 

to hold examinations whenever necessary, to 

examine all applicants who are required to be 

licensed or to have their names ».laced upon 

eligible lists for appointment ..4 the schools 


+ « « » and to prepare all necessary eliyible 
lists. ae 


"Appointments and promotions in the civil 


6205 
Similarly, Section 2590-j of the Education Law provides: 


"3. (a)(1) The board of examiners shall 
prepare and administer objective examinations 
to determine the merit and fitness of all can- 
didates for .. . Supervisory service posi- 
tlons. 2. 2." 


% % # 


{[b.] (3) The board of examiners may 
establish an ciigible list for any class 
of positions for which it finds inadequate 
numbers of qualified persons available for 
recruitment." 


! In addition, Section 2573(2) provides, in part: 


"The superintendent of scnools shall 
require the desl of examiners, in anticipa- 
tion of the ressonable needs of the school 
system, to aagace examinations so that 
eligible lists may be ready for promulgation 
@S soon aS vacancies come into existence. 
Where vacancies already exist and cannot be 
filled because eligible lists have been ex- 
hausted, the superintendent of schools shall 
require the board of exeminers to hold exam- 
inations forthwith. y 


The Consent Judgment 


8. After the Court of Appeals for the Second 


herein, defendant Board of Examiners moved, by notice of 


motion dated June 1, 1972, to modify that preliminary 


| a a a aN NNN NN een 


‘ System which was submitted with that motion. On the 


| return date of the motion, Judge Mansfield suggested that 


it would be preferable for the parties to reach agreement 
on a system for new examinations since the Court was not 
as weli equipped to resolve the educational and other 
issues. raised by the motion. Accordingly, at Judge Mans- 
field’s suggestion, a decision on the motion wes deferred 


while the parties negotiated to see whether they could 


reach agreement upon a plan for such new examinutions. 


im me 4 er: 


é 


ae Se 


Circuit affirmed the issuance of a preliminary injunction 


injunction to permit new plenary examinations pursuant to 


| 
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9. In light of the provisions of the New York 


Education Law quoted above, the Board of Examiners did not 
have to engage in such negotiations with plaintiffs and 
others.* It did so out of a desire to give its new exan- 
inations greater community acceptance. 

10. In any event, during the negotiations between 
the parties, which commenced shortiy thereafter, the parties 
agreed to a two-part settlement. First, an “interim” 


selection and iicensing system using on-the-job performance 


evaluations would be implemented so that "acting" super- 
visors expeditiously could obtain licenses. Second, a 
permanent Plan for a comprehensive system of plenary exam- 
inations would be developed by the parties. On or about 
April 2, 1973, a Stipulation cf Settlement between the 
plaintiffs, the Board of Examiners and the Chancellor of 
the City School District was submitted to the Court.** 

11. On July 12, 1973, after a number of hearings, 


@ Consent Judgrent*** was entered with respect to all 


| 

Moreover, it was clear from both Judge Mansfield's | 

decision granting a preliminary injunction and from 

the Court of Appeals' decision (see below) that 

plenary examinations could and should be devised to 

meet the objections raised by plaintiffs. 
| 
| 
H 
| 
| 


The Stipulation of Settlement provided that it ". .. 
is entered into as a compromise of a disputed clain" 
without defendants admitting any of plaintiffs' allege- 
tions. (Stipulation, para. VI.) 


The Consent Judgment provided, inter alia, (1) that it 
was based upon the Stipulation of Settlement and the 
Court's approval of it (Judgment, para. I.B.); (2) that 
entry of it ". . . shall not constitute any deterrina- 
tion of yrongdoing or misconduct on the pari of any 
party . . ." (Judgment, para. XIII); (3) that, except 
insofar as plaintiffs' claims were resolved by the terms 
of the Judgment, they were "dismissed with prejudice on 
the merits" (Judgment, para. XI); and (4) that plain- 
tiffs and members of plaintiffs' class were enjoined 
from “instituting or prosecuting any suit or other pro- 
ceeding" to enforce claims "included in or comprehended 
by" any of plaintiffs’ claims since plaintiffs' claims 
were being, “compromised, settled and extinguished" 
(Judement, pa> a. XII). 


| 
a 
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parties other than the Board of Education and, as noted 


below, a parallel order was entered with respect to it so 


that the “interim" system could be implemented. (A copy 


of that Consent Judgment is annexed hereto as Exhibit A.) 


le, The Board of Education refused to sign the 


Stipulation of Settlement because, in its Judgment, the 
settlement would grant permanent appointments or licenses 
to supervisors without compliance with New York's con- 
stitutional and statutory scheme. Plaintiffs moved to 
enter a default judgment against the Board of Education on 
the ground that it had never answered. Although Judge | 
Mansfield denied that motion, he modified the preliminary 
injunction against the Board of Education so that its terms 
were virtually identical to those of the Consent Judgment. 
13. The Consent Judgment expressly provided 

that it would subsequently be modified to incorporate, and 
permit implementation of, a permanent Plan for a compre- 


hensive system of plenary supervisory examinations. (See 


Judgment.) 


{ 
| 
Paragraphs’ Vil, Vili, IX, % and XLV of the Consent | 
The Plan for Flenary Examinations. | 


14. During late 1973 and early 1974, the parties 


continued to negotiate with respect to such a Plan. 


Finally, on May 24, 1974 all parties Jointly submitted a 


| Plan for plenary examinations to Judge Tyler. All parties 
had jointly developed and agreed upon that Plan -- with tne ; 
exception of two issues (the method of selecting con- 
sultants and reporting provisions) which are not here in 


dispute and which the parties agreed to submit to the Court 


for resolution. 
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15. Defendants moved on December 20, 1974 to 
resolve the open issues in their favor, to have the Plan 


approved, to incorporate the Plan with the terms of the 


| 
| 
Consent Judgmert and to permit the administration of | 
plenary supervisory examinations pursuant to the Plan. | 
Then plaintiffs moved on January 3, 1975 to resolve the | 
open issues in their favor and, like defendants, to approve 
the Plan. The only differences in the Plan as submitted | 
by the two sides related to the two open issues. | 
16. At a hearing on January 14, 1975 with eeseet. 
to the motions, Judge Tyler approved the Plan and endorsed a 
memorandum decision on defendants' motion papers to that 


effect. It reads in part: 


"In essence, then, the plan as set forth 
in the appendix to the affidavit of Dr. 
Murray Rockowitz verified on December 20, 
1974 is approved." 


17. Thereafter, the two open issues were finally 
resolved and, on March 25, 1975, an "Order Modifying Final 
Judgment and Order" was entered. That order (a copy of | 
which is annexed hereto as Exhibit B), "approved" the Plan 
and formally incorporated it within the Consent Judgment: 


"WHEREAS, all parties herein agreed upon a 
Plan for such plenary examinations, except ihat 
they did not agree on the method of choosing the 
consultants to be used by °efendants under the 
Plan and they did not agiee upon a reporting 
provision, and they submitted the Plan to this 
court on May 24, i974: . , : 


% e % 


VI. The Plan for a comprehensive system of 
plenary examinations for Supervisors in the New 
York City School System which was annexed as an 
exhibit to the affidavit of Murray Rockowitz, 
Sworn to December 20, 1974, and a copy of which 
is annexed hereto and made a part hereof (the 
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"Plan"), is approved as herein modified* and, : 
notwithstanding any otiier provision in the ' 
July i2, 1973, Judgment and Order, defendants 
are permitted and authorized to develop exan- 
inations for supervisory positions and there- 
after to administer and conduct such examinz- 
tions, to process and grade such examinaticns, 
to promulgate eligible lists and to issue 
licenses based upon such examinations, ali -.7 
accordance with that Plan."** 


18. In short, the contents of the Plan, «hich =s: 
been jointly developed and agreed to by all parties, hed 


been known since “sy 1974, the Plan was approved by Judzs 


Tyler in January 1975 and it has been formally part of the 


The Board of Education's 
Responsibilities Under 
the Plan With Regard to 


Job eaves... lr 


19. By its terms, the Plan "outlines a procecurs 


Judgment since March 1975. | 
i 


for the development of examinations by the Board of 
Examiners to fulfill its statutory responsibility" to prso- 
vide "objective", non-discriminatory examinations to deter- 


mine "merit and fitness" (Plan, p. 1). The new examina‘ cr. 


* The only modifications in the Plan made by the Court 
related to reporting provisions. 


me eee eee: Se 


** The Order also made the Consent Judgment, as modified, 
applicable to defendant Board cf Education, in ; 
accordance with its consent. Thus, the Order provides: 


"Whereas, the court has received a letter 
dated March 10, 1975, from the Board of Educée- . 
tion indicating its consent to the entry j 
against it of the Final Judgment of July 12, : 
1973, previously entered against the Board cf 
Examiners; . . . 


% % % 


IV. As of the effective date of this Order, 
the provisions of the Final Judgment of July 
12, 1973, as modified, shall apply fully to 
all of the defendants, and all the defendants 
shall be bound thereby." 


Ss 


Ae a ee 
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procedures are to be a two-step process. First, a. "Step 1” 
plenary examination will be administered to all applicants 
to screen out “those who fail to meet levels of minimum 
acceptable performance". Persons who Pass will rece v’ a 
provisional license. This examination is to be prepare, t> 
the Board of “xaminers tased upon a job analysis of the 
Supervisory position prepared by the Board of Education. 
Second, a "Step 2” on-the-job performance evaluation will 
ine administered by the Board of Examiners to persons who 
on a provisional license and who serve on the JOD in 4 
ee for one year. Those who are sucecseful are to 
pte a permanent license. 
20. Initially, the Plan requires + © Board of 
Examiners, utilizing an independersé consu’*ing firm, 
Developme:it Dimensions, Inc.,* to vrepare ‘ep » examina- 
tions for three prototypical supervisory positions Before 
those prototype examinations can be prepared, %oOwever, pro- 
totype job analyses are to be a:veloped by the Board of 
Education utilizing its independent consulting firm, 
American Institutes for Researz..% Both the prototype job 


analyses and the prototype Step 1 examinations are then to 


TTT 


serve as models to aid in the preparation of analyses and 


examinations for each Supervisory position. 


' 

| 

| 

| 

* At the end of June 1975, the Board of Education entered 

into a contract with Development Dimensions, Inc. whereby | 

Chat firm is to develop the prototype examinations for 

the Board of Examiners. Partial Payneat has already beer. 
made to Development Dimensions under that contract. 


** Well prior to the entry of the March 25, 1975 order, the 
Board of Education had already chosen American Institutes 
for Research ("A.I.R.") as its consultants to develop job 
analyses. It would appear that a contract between the 
Board of Education and A.I.R. had already been signed by 
that date. 


Py 
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21. An examination of the terms of the Plan ccn-'! 


Clusively demonstrates that it is mandatory and directory, 
rather than discretionary, insofar as it requires the Boar: 


of Education to adopt job analyses for the prototypical 


"§ 
in 


positions and insofar as it requires the Board of Examines 
to then prepare the three prototype Step 1 examinations. 
22. Initially, the Plan describes the Board of 


Education's function in the development of job analyses f 


oO 
y 


Supervisory positions: 

"The Board of Education, in consulta- 
tion with the Board ui Examiners and other | 
interested persons and groups, will develop | 
job analyses for all positions for which the 
Board of Examiners is required to conduct | 
examinations. The job analysis will be | 
based. ..." (Plan, p. 2) (Emphasis added) 

23. In describing the data from which job 
analyses will be prepared, the Plan states: "As a | 
general rile, the job analysis will be developed from data 
which will be accumulated in the following way. ..." 
(Plan, p. 3) (Emphasis added) 

24. The Plan indicates that ". . . to insure 
j the soundness of the job analyses" the Board of Education 


"will subject each analysis to review by..." a group of 


| 

designated persons such as community school board supver- | 

intendents and incumbent Supervisors. The Plan provides | 

that "the final selection" of such persons "shall be by 

Cecision of the Board of Education". (Plan, p. 5) | 
25. Although the designees are to review each 

job analysis and make recommendations with regara to it, 


the Plan provides that "the decision of the Board of 


Education, however, shall be final". (P. 5} (Emphasis 
added ) 


Education 


described 
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26. Next, the Plan provides that the Board o 
"shall" prepare job analyses from the datz 
in the Plan: 


"Based on the data developed in '1l' 
above, the Board of Education shall pre- 
pare a job analysis and description for 
each position for which examinations are 
to be conducted. This job analysis shall 
set out and fully elaborate all of the 
important qualities and/or behavicrs 
necessary for performance of the job." 
(P. 5) (Emphasis auded) 


27. The Plan then provides that job analyses 


4 


for 


three prototypical positions shall be prepared by A.I.R., 


the Board 


of Education's independent consulting firm. 


the Plan states: 


"In order to insure broad public accer- 
tance as to the objective implementation of 
the procedures set forth herein and in '1l' 
above the Board of Education will retain 2 


recognized consulting firm to develop and 
prepare the first three job analyses as prc- 


totypes pursuant to the procedures set fortn 
herein and in 'l' above and/or such other 
procedures as the firm deems approvriate. 
The prototype analyses shall cover the posi- 
tions of Principal - Elementary School, 
Assistant Principal - High School (Super- 
vision), and Assistant Principal - Elementery 
and Junior High. These positions cover the 
largest number of people in the supervisory 
categories, thus permitting the program to 
start in a meaningful way. These analyses 
wiil thereafter serve as models for future 
Job analyses to be developed by the Board 

of Education." 


*% * * 


"The Board of Education has designated 
American Institutes for Research, 3301 New 
Mexico Avenue N.W., Washington, D.C. 20616, 
as its consultant in connection with the 
development of job analyses for prototype 
examinations." (Pp. 6-7)* (Emphasis added) 


Vi 


Thus, 


* The Plan also provides that the Board of Education may 
use consulting firms "in the development of future job 
Py a ' ry 


“ sf s » 
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628 28. After job analyses prepared by the Board of 
e / 


Education and/or its consultants have been ccempleted, the 


Board of Examiners are to develop plenary supervisory exe-- 
inations based upon them. Thus, the Plan states: 


"The Board of Examiners will develop 
examinations based on the aforesaid job 
analyses which measure the applicant's 
capacity to perform the Significant job nm 
requirements as indicated by the analysis. 
This examination process will be divided 
into two steps. Step 1 will consist of a 
series of tests to be given to all eligible 
applicants for the primary purpose of 
evaluating the applicants’ strengths and 
weaknesses. Ali persons who meet levels of 
minimum acceptable performance under Step 1 
shall be declared eligibie for provisional 
appointment to the position in question. 
Step 2 of the examination process will be 
administered to those persons who secure 
Such provisional appointment. It shall 
consist of an on-the-job performance evalua- 
tion at the end of one school year of pro- 
visional service. Any person found to be 
performing reasonably in the Step 2 evalua- 
tion shall be awarded a permanent license 
for the position in question." (P. 8) 


29. Finally, the Plan provides that the "interi-" 
on-the-job performance evaluation System is to be phased 
out ". . . one year from the date of the announcement by 
the Board of Examiners of the last of the aforementioned 
three prototype examinations." (Pp. 18) Thus, until the 
three prototype examinations are prepared and announced, 
the "interim" system -- which the Board of Education has 
contended does not meet the requirements of State law -- 


will stay in effect. * 


ALLL nents 


* In 1973 and 1974 the Board of Education argued that the 
"interim" on-the-job performance evaluation system 
violates the requirements of New York State's Constitu- 
tion and its Education Law and that it was “imperative" 
that a Plan for plenary examinations "consistent with 
constitutional requirements" be adopted as expeditiously 
as possible. (See letter dated April 2, 1973 from 
Leonard Bernikow, Assistant Corporation Counsel, to 

q Judge Mansfield.) After its position was rejected in 


a 


| 


i 
| 
| 
| 
| 


| 
| 
| 
| 
| 
| 
| 
| 
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The Board of Education Has 


Failed and Refused to Adopt 
Prototype Job Analyses. 

30. As noted above, the jointly develoned Plan 
for plenary examinations was originally submitted to this 
Court in May 1974; and the Court approved it in January 
1975 and made it a part of the Consent Judgment in March 
i975. Yet, the Board of Education has nat, to date, cone 
forward with prototype job analyses acceptable to it. : 
The Board of Education's default in this regard delays the 
Board of Examiners’ ability to prepare the prototype exan- 
inations and, thus, has the effect of keeping this case in 


an unfinished state.* 


this Court, the Board of Education appealed to the Seccrn¢ 


Circuit and argued: 


*“It was improper to direct that permanent 
appointments be made wivtncut compliance with 
the requirements of the State's constitutionai 
and statutory requirements of merit and fitness 
determined by competitive examination. Such a 
direction would be improper even in a final 
judgment since the alleged discrimination 
could be cured by requiring proper methods 
of testing without any need for disturbing 
the State's constitutional and statutory 
requirements." (Brief of Appellant Board 
of Education dated November 13, 1973, 

Docket No. 73-2320, p. 19) 


Moreover, tne Board of Education's brief quoted the terms 


of Education Law, § 2590-j(3)(a)(1) which provides that 
the Board of Examiners “shall prepare and administer 
objective examinations to determine the merit and fitnes 
of all candidates for . . . supervisory service position 
." and concluded that to obtain a permanent appoint- 

ment “to a supervisory position under New York law an 
applicant must "., ‘ 
by the New York City Board of Examiners". (Board of 
Education's Brief, pp. 26, 27) 


i 


= 


° 


< 


pass an objective examination giver. 


| 


| 
| 
| 
| 
| 
| 
| 


! 
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As noted above, the "interim" selection system continues ; 


in effect until the three prototype Step 1 examinations 
are announced. 


630m j31. As is more fully shown in the accompanying 
j affidavit of Dr. Julius R. Rubin, the Chairman of the Boaré 
of Examiners, when the Board of Education's delay first 
} became apparent, the Board of Examiners informally attempte¢ 
| to expedite the Board of Education's adoption of the proto- 
j type job analyses; and when informal persuasion did not 
| prove successful, the Board of Examiners instructed its 
} counsel to bring the Board of Education's default to this 
| Court's attention. 
32. Moreover, as is more fully shown in the 

accompanying affidavit of Saul Z. Cohen, counsel to the 
| Board of Examiners, despite pre-motion conferences with 
} this Court on January 22 and March 4, 1976, the Board of 
| Education has still not adopted the prototype job analyses 
} required by the Consent Judgment. 

The Courts Have Uniformly Called 

for the Implementation of Plenary 
| Examinations as Sooi) as Possible. 

33. Every court that has come in contact with 
this matter has expressed the view that plenary examina- 
tions created by the Board of Examiners should be adminis- 
tered by it forthwiin. As long ago as July 14, 1971, 
Judge Mansfield, in his decision granting plaintiffs' 
motion for a preliminary injunction, stated: 

". . . such relief may possibly lead the 

Board of Examiners, after taking another 

hard look at its examination procedures, 

to consider an overhaul that will not only 

eliminate racial discrimination, but lead 

to procedures that will be more adaptable 

to the Community School Board type of 

| administration.” 330 F. Supp. 203, 224 
(1971). 

i 

34. When the Court of Appeals for the Second 


| Circuit affirmed the issuance of a preliminary injunction, 


| it specifically went out of its way to note that: 
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"The {district court] judge did not outlaw 
other written examinations or indicate that 
none could be created to test more fairly 
the qualities necessary for a supervisory 
job. It may well be that new testing pro- 
cedures will be devised by the parties 
themselves and be approved by the district 
court. Certainly, the case should not 
linger on in its present unfinished state." 
458 F.2d4 1165, 1179 (1972). 


35. When Judge Mansfield approved the 1973 


eeensentiainameemesmetiee 


settlement, he repeatedly noted his expectation that "a new 
permanent appointment system" should be rapidly adopted. 

In fact, Judge Mansfield preliminarily approved the settle- 
ment, onlv cn condition that the Stipulation of Settlement 
be amended to include a provision whereby, within six 
months, the part’es would either agree upon a new system 

of plenary eaaminations or would come back to Court to 
litigate that question. Thus, his May 21, 1973 decision 
held: 


ETN A | seen seme a 
. 


"The ideal solution would be the immediate 
establishment of a new permanent appointment 
System. But like ancient Rome such a system, 
which requires a careful study and analysis of 
numerous complex factors bearing on job related- 
ness, fairness and evaluation of performance, 
cannot be built in a period of days cr even of 
weeks. However, although we ave prepared to 
accept and adopt the stipulation, we are 
persuaccd that the parties should be stimulated 
to bend even greater efforts toward formulation 


of a final plan for a new permanent system 
within six months.” (Emphasis added) 


36. After notice of the settlement had been giver. 
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and hearings had been held, Judge Mansfield rendered a 


decision on July 10, 1973 finally approving the Stipulation 


of Settlement. Again, he noted his expectation that 
permanent examination procedures would be agreed to by 
the parties: 


"We share the hope expressed by the New York 
Court of Appeals in Board of Education of the 


City of New York v. Nyguist, N.Y¥.20 ; 


~ 
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N.Y.L.J. Mar. 12, 1973,* that a permanent 
examination procedure meeting constitutional 
requirements will be devised by the parties. 
However, the parties advise that a substan- 
tial additional amount of time will be re- 
quired for the development of such a system, 
Since agreement must be reached as to an 
overall plan and the plan must then be 
implemented by adoption of specific exam- 
ination procedures for numerous positions." 
} 
i 


57. Thereafter, when the Court of Appeals for 
the Second Circuit affirmed the District Court's approval 
of the settlement, it specifically noted the impropriety 
of continuing to permit permanent appointments pursuant to 
| the "interim" on-the-job performance evaluation system and 
the desirability of "promptly" adopting "a permanent non- 
discriminatory testing system": 


"Finally, we must note that were the 
litigation to remain indefinitely in its 
unfinished state, the propriety of con- 
tinuing to allow permanent appointments 
would be another matter. The interim tail 


would then be wagging the dog and the in- 


centive for plaintiffs' class to obtain a 
ermanent non-discriminatory testing system 
would diminish considerably and perhaps 
disappear. Indeed, we think too much time 
has already elapsed and we regret that the 
district court did not require the parties 
to adhere to the six-month time period it 
Suggested in approving the settlement. 
Allowing another lengthy period of time to 
go by, thus creating further eligibles for 
permanent appointments as an ‘interim’ 
measure, would approach an abuse of dis- 
cretion. Accordingly, while we affirm the 
Judgment of the district court, we suggest 
that the litigation be promptly brought to 
a close, either by judicial resolution of 
contested issues or by settlement." 496 


F.2d at 820, 825 (2nd Cir. 1974) (Emphasis 
added) 


38. Finally, Judge Tyler concluded his Aprii i, 


1975 memorandum decision accompanying the March 25, 1975 


* See 31 N.Y.2d 468, 474-475, 341 N.Y¥.S.2d 441, 446-447 
(1973). 
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"Order Modifying Final Judgment and vicer"” by also noting 


the desirability of implementing the permanent system for 


2 


plenary supe sory examinations "as soon as possible": 


"The community is entitled to the competitive 
examination iicensing procedure, which its 
legislature has determined appropriate, as 

soon as possible. The community is also 

entitled to a system which satisfie& con- 

stitutional standards. The March 25th order 

and Plan was entered to effectuate these 

goais as well as poss.ble." (Emphasis ad’ed) 
Conclu:ion. 

39. As was shown above, the Board of Examiners 
had no cbligation to reach agreement with either plaintiffs 
or with the Board of Education with regard to the content 
of new plenary examinations. It is indeed ironic that the 


Board of Examiners' efforts to reach such an agreement with 


cena er enenen 


the other parties has resulted in a delay in the creation 
and administration of new examinations of a? most four 


years. This Court should not permit any further delay. 


~ A 
/ ne 
f? <a7 i) ot wi Ans hota a 
“Murray Rockowitz 


Sworn to before me this 


ee 


/‘ day of April, 1976 


ae 


Cee Prd 


~ Notary Public 


+f o 
uw “ w 4 


Qudlifies in We tay ior 
i fC ie Count 
Cost God in Nockicn- County. 


Term expires Marc’; 22, Wey. 
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“NITED STATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 


ee x 
BOSTON M.- CHANCE, et al. : 

Plaintiffs, 

70 Civ. 4141 
against- : (M.P.) 

THE BOARD OF EXAMINERS AND THE — AFFIDAVIT 
BOARD OF EDUCATION OF THE CITY 
OF NEW YORK, et al., 

Defendants. 
— meme wee mee x 
STATE OF NEW YORK ) 

<5 eSsce 
COUNTY OF ) 
JULIUS R. RUBIN, being duly sworn, deposes and 

says: 


1. I am Chairman of the Board of Examiners, am 
fully familiar with the facts herein and submit this affi- 
dGavit in support of the Board of Examiners! motion to 
require immediate implementation of the Consent Judgment. 

2. The "Order Modifying Final Judgment and Order" 
which was entered on March 25, 1975 appruved the permanent 
Plan for a comprehensive system of plenary examinaticns for 
supervisors in the New York City school system and made that 
Plan part of the Censent Judgment. After that Order was 
entered, it was the expectation of the Board of Examiners 
that the Board of Education and its designated independent 
consultants, American Institutes for Research ("A.I.R.") 
would proceed expeditiously to prepare and adopt the three 
prototype job analyses required by the Plan. In fact, in 
the Spring of 1975, the Board of Examiners was already 


considering scheduling the first of the prototype 
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examinations for the Fall of 1975 in the expectation that 
the job analyses would be completed well before the end of 
the prior school year. 

3. When it became apparent to the Board of 
Examiners that the Board of Education and A.I.R. were not 
proceeding expeditiously, I, acting as the Chairman of the 
Board of *xaminers, and Saul Z. Cohen, the Examiners' 
counsel, informally attempted to expedite the Bcird of 
Education's adoption of the prototype job analyses. Thus, 

A. In June 1975, at the request of the Board 
of Examiners, Mr. Cohen spoke with Harold Siegel, Secretary 
to the Board of Education, to inquire spout the A.1.R. job 
analyses and was assured that A.I.R. was developing the 
prototype job analyses in accordance with the Plan. 

B. During August and early September 1975, I 
made many telephone calls to Mr. Siegel, inquiring about 
the status of the A.I.R. analyses which I understand the 
Board of Education received in June 1975. At those times, 
I recommended tnat the Board of Education promptly review 
the analyses and act upon them. 

C. On September 9, 1975 I met with Mr. 


Siegel and argued that the A.I.R. prototype job analyses 


should be promptly presented to the Board of Education for 


} action. 
D. On or about September 11, 1975 Mr. Siegel 


sent to exch: member of the Board of Education copies of the 
three completed A.I.R. job analyses, and recommendations by 
the Board of Education's six designated reviewers with 
regard to those analyses. Annexed as Exhibit C to this 
motion is a copy of Mr. Siegel's memorandum dated September 


41. 3075. 
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E. By memorandum dated September 23, 1975, 


I informed Mr. Siegel that Development Dimensions, Inc., 
the Board of Examiners' independent consultants, had 
reviewed the A.I.R. job analyses and had concluded that 
they "can be used . . . towards the development of the 
prototype examinations in accordance with the final judg- 
ment of the Court. . . ." Copies of my menorandum and of 
Development Dimensions, Inc.'s letter dated September 16, 
1975 are annexed as Exnibit D to this motion. 

F. After further meetings between the 
parties, I wrote to Chancellor Irving Anker, by memorandum 
dated December 5, 1975, calling attention to "the pro- 
tracted delay in the implementation of the Final Judgment" 
and requesting prompt action to facilitate the administra- 
tion of prototype examinations in the Spring Term of. 1976. 
A copy of that memorandum is annexed as Exhibit E to this 
motion. i 

4, When these repeated informal attempts to 
secure action proved unsuccessful, the Board of Examiners 
requested its counsel to take appropriate steps before this 
Court. As is shown more fully in the accompanying Cohen 
affidavit, as a result of our request, pre-motion con- 
ferences were held with this Court on January 22 and March 
4, 1976, and, after further delay, this Court granted the 
Board of Examiners permission, under its rules, to make 
the instant motion. 

5. Each of the members of the Board of Examiners 
is dedicated to carry out its statutory responsibility to 


"prepare and administer objective examinations to deter- 


mine the merit and fitness of all candidates for... 
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supervisory service positions. . . ." New York Education 
Law § 2590-§(3)(a)(1). The Plan for plenary examinations 
contains a flexible blueprint for such examinations. The 


Board of Examiners should be allowed to implement that 


Plan forthwith. 


Sworn to before me this 


4 


14 day of April, 1976 


bhwe Wd a 


tame? tl gt 


MAnY Mi. CHIR AN - ; 
Commissioner cf Deeds. City of New Yor 
Kings County Clerk - No. 2-591 
Commission Expires July 1, 1977 
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UNITED STATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 


—--|- |= = = = |e we we ee ee ew ew ew Ke x 
BOSTON M. CHANCE, et al., 
Plaintiffs, 
76 Civ. 4141 
-against- : (M.P.) 
THE BOARD OF EXAMINERS AND THE ae AFFIDAVIT 
BOARD OF EDUCATION OF THE CITY 
OF NEW YORK, et al., 
Defendants. 
Oe x 
STATE OF NEW YORK ) 
an.: 


COUNTY OF NEW YORK ) 


SAUL Z. COHEN, being duly sworn, deposes and says: 


1. I am a member of the firm of Kaye, Scholer, 
Fierman, Hays & Handler, counsel for the Board of Examiners 
herein. I have been in overall charge of the legal repre- 
sentation of the Board of Examiners in this action since 
its commencement in 1970 and am fully familiar with the 
Matters set forth herein. 

2. In view of the Board of Education's failure, 
by the end of 1975, to adopt the three prototype job 
analyses .required by the Consent Judgment, as modified, the 
Board of Examiners instructed me to take action before this 
Court to implement that Judgment. In accordance with this 
Court's rules, I requested a pre-motion conference. 

3. At that conference on January 22, 1976, 
counsel for the Board of Education pleaded for additional 
time to carry out its responsibilities under the Plan with 


respect to the job analyses. At no time during that con- 


ference was there any suggestion that the Board of Education 


o 
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wished to modify that Judgment in any way. In fact, 


Michael Rosen, Esq., counsel to defendant Chancellor of 
City School District, expressly stated that the Board 
of Education intended to carry out its responsibilities 
under the Plan. Accordingly, although this Court indicated 
that the Board of Education's conduct appeared to be 
contumacious, it agreed to a six-week adjournment of the 
pre-motion conference until March 4, 1976 so that the 
Board of Education could fulfill its responsibilities with 
respect to the job analyses. 

4. At the adjourned conference on March 4, 
counsel for the Board of Education explained that it had 
rejected the three prototype job analyses which had been 
created by its consultants, and announced, for the first 
time, that the Board of Education wished to move to modify 
the Plan which is part of the Consent Judgment. The Board 
of Education's counsel also stated that it and plaintiffs' 
counsel were already in the midst of meetings with respect 
to such a modification and, for that reason, expressed 
reluctance to discuss details of it. Over my objections, 
this Court deferred action on the Board of Examiners' 


motion to implement the Consent Judgment and adopted a 


schedule for the Board of Education's motion to modify 


that Judgment. 

5. When it became apparent that the Board of 
Education was not even proceeding expeditiously to move 
to modify the Judgment, my colleague, Howard A. Jacobson, 
wrote to this Court, on the Board of Examiners’ behalf, 


requesting permission to make the instant motion. (A copy 
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of that letter is annexed as Exhibit F to this motion.) 


This Court thereafter grant 1 such permission. 


| ! ie s as 


™ saul zr Cohen 


Sworn to before me this 


“Un 
jf “day of April, 1976 


ie, * ‘ 
ees 
fit; Forel (tee 


Notary Public 


CONSTANCE VAIRO 
NOTARY FULLIC, State of New Yor 
No. 24-9421950 
Qualified in Kings County 
Commission Expires Biarch 30, 1973 


Exhibit A -— Final Judgement, dated 
July 12, 1973 
(Printed at pp. 250a-259a) 


Exhibit B - Order of Judge Tyler 
(plus exhibit), dated 
March 25, 1975 


(Printed at pp- 505a-538a) 


